-- Logs begin at Tue 2021-04-20 18:49:40 UTC, end at Tue 2021-04-20 19:50:16 UTC. -- Apr 20 19:20:00.327369 dv-cinder-787264-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 19:20:00.334897 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 19:20:00.337024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 19:20:00 2021] *** Apr 20 19:20:00.337024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 19:20:00.337024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 19:20:00.337024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: nodename: dv-cinder-787264-1-iscsi Apr 20 19:20:00.337024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: machine: x86_64 Apr 20 19:20:00.337024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: clock source: unix Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: pcre jit disabled Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: detected number of CPU cores: 4 Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: current working directory: / Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: detected binary path: /usr/bin/uwsgi-core Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: dropping root privileges as early as possible Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: your processes number limit is 47843 Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: your memory page size is 4096 bytes Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: detected max file descriptor number: 2048 Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: lock engine: pthread robust mutexes Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: thunder lock: enabled Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: dropping root privileges after socket binding Apr 20 19:20:00.337542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 19:20:00.382507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: Python main interpreter initialized at 0x558df28399c0 Apr 20 19:20:00.382507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: dropping root privileges after plugin initialization Apr 20 19:20:00.382507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: python threads support enabled Apr 20 19:20:00.382507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: your server socket listen backlog is limited to 100 connections Apr 20 19:20:00.382507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: your mercy for graceful operations on workers is 90 seconds Apr 20 19:20:00.382992 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 19:20:00.382992 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: *** Operational MODE: preforking *** Apr 20 19:20:00.383176 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: dropping root privileges after application loading Apr 20 19:20:00.383176 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: *** uWSGI is running in multiple interpreter mode *** Apr 20 19:20:00.383176 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: spawned uWSGI master process (pid: 85689) Apr 20 19:20:00.384811 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: spawned uWSGI worker 1 (pid: 85690, cores: 1) Apr 20 19:20:00.384811 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: spawned uWSGI worker 2 (pid: 85691, cores: 1) Apr 20 19:20:00.384811 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 19:20:00.383304 dv-cinder-787264-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 19:20:05.361163 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:20:05.362415 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:20:05.363502 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:20:05.363932 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:20:05.364220 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:20:05.364677 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.365067 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.365426 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.365783 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.366157 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.366505 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.366863 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.367218 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.367588 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.367881 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.368232 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.368599 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787264-1-iscsi {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.368995 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.369334 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.369678 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.370040 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.370383 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.370745 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.371091 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.371697 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.372043 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.372382 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.372745 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.373145 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.373494 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.373839 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.374199 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.374545 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.374909 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.375253 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.375613 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787264-1-iscsi {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.375961 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.376311 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.376662 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.376952 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:20:05.377213 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.377321 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:20:05.377645 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.377990 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.378352 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.378716 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.378865 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:20:05.379056 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.379197 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:20:05.379429 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.379576 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:20:05.379786 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.379926 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.380145 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.380285 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.380502 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.380643 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.380864 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.381004 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.381207 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.381363 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.381547 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.381686 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.381904 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.382063 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.382243 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.382402 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.382582 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.382730 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.382866 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.383002 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.383193 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.383347 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.383492 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.383629 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787264-1-iscsi {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.383848 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.383989 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.384211 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.384363 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.384509 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.384647 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.384811 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.384958 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.385106 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.385243 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.385393 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.385607 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.385748 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.385954 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.386101 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.386366 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.386573 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.386719 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.386918 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.387024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.387264 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.387368 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.387613 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.387717 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.387948 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.388051 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.388304 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.388407 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.388648 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.388775 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.389028 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.389133 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.389369 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.389473 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.389727 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.389835 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.390067 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.390175 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.390431 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.390544 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787264-1-iscsi {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.390776 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.390866 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.391131 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.391237 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.391486 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.391583 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.391828 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.391990 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.392186 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.392333 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.393100 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.393229 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.393451 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.393658 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.393827 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.393942 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.394111 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.394231 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.394469 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.394623 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.394817 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.394968 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.395156 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.395302 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.395451 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.395593 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.395734 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.395875 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.396059 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.396204 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.396417 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.396539 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.396778 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.396902 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.397122 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.397292 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.397458 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.397579 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.397726 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.397867 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.398062 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.398194 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.398412 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.398557 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.398751 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.398897 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.399090 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.399242 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.399390 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.399494 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.399593 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.399743 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.399956 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.400066 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.400322 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.400431 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.400675 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.400839 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.401013 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.401122 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.401362 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.401465 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.401708 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.401810 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.402054 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.402158 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.402387 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.402489 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.402722 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.402823 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.403066 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.403169 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.403400 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.403503 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.403737 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.403857 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.404094 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.404204 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.404432 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.404547 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.404790 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.404916 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.405150 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.405254 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.405492 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.405588 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.405828 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.405932 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.406176 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.406278 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.406509 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.406603 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.406851 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.406956 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.407206 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.407307 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.407541 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.407641 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.407881 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.407975 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.408775 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.408873 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.409130 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.409291 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.409474 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.409639 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.409783 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.409893 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.410122 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.410226 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.410460 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.410565 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.410793 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.410902 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.411137 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.411245 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.411492 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.411595 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.411833 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.411935 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.412167 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.412275 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.412507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.412617 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.412874 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.413033 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.413224 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.413625 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.413826 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.413971 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.414173 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.414317 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.414521 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.414655 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.414861 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.415013 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.415199 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.415325 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.415549 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.415702 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.415890 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.416034 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.416229 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.416373 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.416587 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.416765 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.416973 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.417117 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.417316 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.417460 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.417655 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.417800 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.418001 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.418152 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.418347 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.418498 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.418703 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.418863 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.419048 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.419192 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.419385 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.419536 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.419730 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.419882 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.420071 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.420216 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.420415 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.420565 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.420793 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.420949 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.421142 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.421293 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.421482 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.421634 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.421835 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.421978 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.422174 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.422319 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.422520 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.422672 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.422882 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.423034 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.423220 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.423364 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.423565 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.423717 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.423920 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.424064 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.424326 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.424472 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.424612 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.424784 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.424940 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.425159 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.425311 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.425451 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.425601 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.425754 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.425895 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.426041 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.426181 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.426321 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.426527 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.426672 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.426893 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.427044 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.427192 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.427346 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.427488 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.427628 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.427827 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.427978 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:20:05.428169 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.428316 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.428526 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.428671 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.428933 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.429075 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.429268 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.429420 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.429645 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.429788 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.429986 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.430130 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.430332 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.430483 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.430678 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.430821 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.431013 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.431157 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.431361 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.431512 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.431705 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.431848 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.432037 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.432191 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.432382 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.432533 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.432744 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.432902 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.433085 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.433229 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.433443 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.433588 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.433782 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.433933 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.434118 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.434261 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.434464 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.434608 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.434810 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.434961 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.435232 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.435393 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.435543 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.435693 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.435844 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.435985 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.436125 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.436270 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.436470 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.436619 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.436882 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.437029 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.437244 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.437389 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.437578 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.437722 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.437942 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.438093 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.438294 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.438445 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.438646 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.438799 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.438947 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.439088 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.439295 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.439473 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.439776 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.439936 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.440079 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.440219 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.440359 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.440498 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.440644 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.440818 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.440969 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.441117 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.441258 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.441498 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.441649 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.441798 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.441941 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.442088 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.442229 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.442441 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.442585 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.442795 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.442940 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.443119 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.443262 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.443402 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.443550 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.443741 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.443885 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.444124 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.444274 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.444464 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.444616 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.444844 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.445003 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.445184 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.445410 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.445555 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.445704 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.445845 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.445992 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.446134 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.446274 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.446485 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.446641 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.446818 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.446971 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.447162 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.447314 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.447505 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.447657 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.447838 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.447982 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.448182 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.448334 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.448484 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.448631 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.448856 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.449008 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.449206 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.449352 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.449549 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.449701 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.449895 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.450038 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.450237 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.450383 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.450588 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.450740 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.450930 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.451074 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.451267 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.451418 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.451613 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.451764 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.451952 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.452112 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.452293 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.452446 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.452637 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.452879 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.453029 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.453176 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.453354 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.453508 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.453692 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.453843 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.454032 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.454183 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.454371 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.454527 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.454675 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.454816 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.455541 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.455697 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.455897 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.456113 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.456256 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.456403 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.456607 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.456772 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.456979 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.457136 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.457318 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.457462 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.457663 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.457809 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.457964 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.458113 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.458302 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.458454 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.458662 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.458808 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.458999 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.459144 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.459330 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.459474 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.459668 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.459813 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.460006 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.460151 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.460387 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.460513 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.460736 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.460884 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.461100 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.461245 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.461453 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.461598 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.461803 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.461949 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.462141 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.462287 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.462481 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.462692 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.462837 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.462987 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.463135 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.463276 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.463471 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.463615 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.463813 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.463965 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.464150 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.464300 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.464491 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.464636 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.464853 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.465010 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.465198 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.465343 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.465545 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.465771 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.465924 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.466075 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.466216 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.466356 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.466546 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.466692 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.466888 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.467034 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.467220 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.467365 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.467563 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.467708 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.467910 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.468057 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.468263 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.468596 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.468800 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.468997 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.469158 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.469308 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.469428 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.469666 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.469812 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.470014 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.470142 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.470360 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.470512 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471102 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471219 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471219 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471406 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471504 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471601 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471788 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.471948 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.472134 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.472243 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.472472 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.472577 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.472834 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.472953 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.473181 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.473285 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.473521 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.473625 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.473861 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.473975 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.474202 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.474311 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.474541 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.474643 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.474871 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.474975 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.475207 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.475309 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.475538 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.475641 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.475876 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.475979 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.476227 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.476330 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.476568 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.476672 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.476940 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.477045 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.477280 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.477382 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.477629 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.477747 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.477969 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.478102 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.478313 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.478424 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.478652 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.478750 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.478992 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.479088 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.479336 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.479431 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.479690 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.479798 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.480040 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.480143 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.480397 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.480507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.480768 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.480890 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.481132 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.481229 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.481477 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.481572 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.481822 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.481938 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.482157 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.482254 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.482492 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.482588 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.482827 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.482934 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.483171 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.483272 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.483507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.483852 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.483956 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.484203 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.484298 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.484546 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.484640 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.484908 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.485011 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.485252 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.485347 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.485589 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.485684 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.485943 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.486055 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.486826 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.486925 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.487166 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.487373 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.487589 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.487695 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.487938 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.488032 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.488283 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.488378 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.488622 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.488744 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.489011 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.489124 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.489357 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.489468 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.489695 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.489805 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.490033 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.490144 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.490365 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.490475 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.490705 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.490874 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.491020 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.491174 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.491367 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.491495 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.491710 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.491820 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.492052 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.492155 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.492388 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.492493 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.492753 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.492860 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.493080 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.493181 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.493418 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.493533 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.493760 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.493863 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.494097 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.494199 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.494433 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.494548 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.494764 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.494868 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.495100 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.495202 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.495437 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.495548 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.495798 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.495900 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.496141 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.496244 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.496481 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.496591 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.496842 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.496948 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.497180 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.497282 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.497541 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.497657 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.497879 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.497981 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.498214 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.498317 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.498566 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.498671 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.498915 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.499017 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.499258 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.499361 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.499600 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.499710 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.499938 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.500085 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.500281 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.500383 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.500617 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.500736 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.500996 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.501146 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.501316 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.501429 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.501655 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.501768 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.502036 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.502141 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.502382 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.502541 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.502725 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.502893 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.503076 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.503255 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.503428 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.503620 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.503772 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.503988 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.504143 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.504328 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.504497 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.504674 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.504860 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.505062 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.505166 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.505408 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.505517 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.505755 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.505859 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.506100 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.506227 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.506447 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.506549 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.506792 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.506902 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.507134 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.507237 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.507470 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.507581 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.507808 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.507912 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.508145 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.508246 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.508481 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.508591 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.508842 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.508950 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.509178 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.509280 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.509524 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.509638 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.509861 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.509964 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.510195 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.510296 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.510530 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.510640 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.510869 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.510971 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.511212 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.511315 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.511541 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.511695 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.511877 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.512027 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.512218 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.512373 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.512610 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.512737 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.512978 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.513080 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.513388 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.513501 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.513727 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.513829 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.514068 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.514170 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.514418 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.514520 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.514756 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.514859 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.515089 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.515192 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.515447 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.515555 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.515799 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.515903 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.516156 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.516258 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.516488 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.516599 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.516849 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.516956 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.517193 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.517306 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.518061 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.518181 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.518411 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.518562 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.518777 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.518879 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.519146 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.519256 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.519518 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.519622 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.519862 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.519970 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.520212 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.520323 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.520564 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.520673 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.520944 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.521048 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.521295 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.521469 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.521646 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.521796 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.521999 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.522108 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.522349 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.522453 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.522698 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.522800 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.523049 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.523158 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.523398 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.523501 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.523732 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.523836 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.524076 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.524181 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.524415 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.524524 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.524793 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.524900 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.525153 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.525257 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.525496 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.525599 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.525841 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.525943 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.526173 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.526283 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.526518 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.526628 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.526869 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.526972 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.527208 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.527319 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.527569 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.527671 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.528019 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.528128 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.528372 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.528482 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.528753 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.528859 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.529080 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.529182 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.529431 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.529545 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.529761 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.529862 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.530101 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.530209 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.530436 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.530546 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.530770 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.530912 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.531109 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.531264 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.531470 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.531614 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.531809 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.531964 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.532153 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.532309 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.532500 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.532652 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.532871 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.533026 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.533265 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.533443 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.533597 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.533789 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.533958 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.534130 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.534297 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.534473 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.534658 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.534843 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.535006 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.535188 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.535364 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.535551 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.535727 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.536024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.536125 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.536383 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.536491 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.536758 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.536864 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.537083 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.537185 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.537421 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.537523 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.537765 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.537869 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.538150 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.538258 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.538741 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.538848 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.539094 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.539198 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.539450 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.539554 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.539805 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.539915 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.540142 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.540251 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.540503 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.540606 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.540882 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.540999 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.541229 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.541332 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.541582 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.541695 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.541917 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.542021 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.542256 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.542358 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.542595 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.542704 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.542943 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.543056 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.543282 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.543383 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.543621 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.543723 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.543958 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.544068 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.544281 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.544442 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.544621 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.544765 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.544986 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.545102 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.545324 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.545431 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.545685 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.545789 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.546024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.546127 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.546385 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.546488 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.546723 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.546825 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.547062 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.547165 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.547397 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.547505 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.547734 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.547835 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.548076 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.548180 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.548427 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.548529 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.548829 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.548982 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.549175 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.549323 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.549542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.549646 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.549887 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.550002 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.550255 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.550357 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.550611 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.550803 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.550960 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.551066 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.551312 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.551425 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.551651 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.551753 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.551993 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.552096 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.552343 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.552447 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.552687 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.552819 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.553047 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.553151 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.553385 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.553499 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.553734 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.553837 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.554082 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.554185 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.554431 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.554535 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.554800 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.555017 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.555175 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.555381 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.555526 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.555730 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.555906 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.556079 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.556278 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.556426 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.556636 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.556873 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.557025 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.557129 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.557394 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.557564 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.557739 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.557843 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.558082 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.558193 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.558421 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.558525 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.558758 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.558861 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.559103 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.559205 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.559446 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.559550 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.559794 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.559899 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.560137 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.560240 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.560480 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.560591 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.560856 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.560974 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.561214 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.561325 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.561552 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.561660 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.561920 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.562029 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.562265 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.562382 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.562602 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.562713 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.562947 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.563099 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.563289 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.563404 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.563633 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.563737 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.563981 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.564083 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.564850 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.564966 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.565216 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.565319 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.565576 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.565739 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.565948 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.566090 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.566303 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.566441 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.566679 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.566783 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.567039 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.567143 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.567396 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.567499 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.567754 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.567880 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.568111 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.568222 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.568467 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.568569 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.568845 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.568966 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.569196 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.569432 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.569535 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.569781 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.569885 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.570152 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.570264 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.570516 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.570619 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.570880 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.571099 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.571212 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.571473 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.571582 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.571829 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.571931 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.572185 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.572297 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.572517 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.572620 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.572889 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.573004 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.573235 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.573342 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.573564 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.573667 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.573913 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.574023 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.574250 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.574353 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.574588 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.574697 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.574943 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.575054 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.575287 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.575391 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.575655 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.575891 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.576044 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.576284 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.576389 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.576632 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.576774 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.577085 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.577196 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.577441 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.577546 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.577784 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.577899 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.578130 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.578234 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.578492 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.578624 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.578830 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.578936 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.579168 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.579279 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.579518 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.579627 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.579861 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.579988 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.580260 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.580381 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.580625 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.580804 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.581024 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.581128 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.581371 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.581484 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.581711 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.581814 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.582057 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.582163 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.582396 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.582509 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.582759 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.582862 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.583099 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.583227 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.583437 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.583542 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.583776 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.583879 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.584122 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.584226 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.584452 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.584563 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.584831 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.585084 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.585197 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.585439 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.585550 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.585797 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.585901 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.586133 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.586235 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.586473 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.586583 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.586810 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.586913 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.587152 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.587262 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.587488 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.587592 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.587831 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.587934 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.588169 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.588270 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.588513 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.588616 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.588883 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.588998 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.589223 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.589326 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.589565 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.589674 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.589909 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.590011 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.590246 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.590349 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.590592 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.590697 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.590934 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.591036 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.591315 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.591552 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.591663 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.591954 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.592243 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.592351 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.592620 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.592758 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.593001 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.593104 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.593349 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.593452 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.593696 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.593811 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.594056 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.594160 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.594392 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.594495 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.594725 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.594835 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.595075 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.595179 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.595414 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.595516 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.596277 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.596393 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.596768 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.596950 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.597114 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.597192 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.597412 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.597526 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.597753 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.597856 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.598100 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.598210 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.598447 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.598551 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.598796 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.598929 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.599135 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.599239 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.599480 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.599584 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.599827 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.599931 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.600174 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.600297 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.600511 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.600615 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.600896 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.601013 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.601235 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.601347 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.601575 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.601680 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.601920 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.602023 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.602257 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.602368 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.602596 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.602698 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.602939 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.603042 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.603284 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.603394 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.603618 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.603722 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.603965 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.604067 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.604310 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.604420 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.604677 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.604825 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.605044 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.605154 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.605387 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.605491 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.605741 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.605844 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.606092 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.606195 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.606455 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.606566 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.606797 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.606900 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.607147 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.607249 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.607486 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.607590 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.607826 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.607929 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.608172 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.608445 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.608555 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.608883 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.609016 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.609640 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.609773 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.609773 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610087 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610189 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610265 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610338 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610467 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610616 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610791 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610896 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.610995 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.611320 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.611436 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.611674 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.611786 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.612033 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.612136 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.612391 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.612512 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.612769 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.612899 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.613124 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.613240 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.613468 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.613633 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.613807 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.613912 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.614152 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.614262 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.614483 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.614597 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.614829 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.614933 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.615167 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.615269 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.615517 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.615629 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.615881 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.615985 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.616223 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.616326 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.616574 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.616684 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.616939 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.617041 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.617283 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.617415 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.617619 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.617731 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.617963 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.618066 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.618317 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.618419 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.618669 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.618779 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.619016 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.619166 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.619362 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.619467 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.619701 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.619842 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.620049 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.620198 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.620394 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.620559 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.620788 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.620952 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.621147 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.621304 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.621494 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.621681 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.621860 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.622068 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.622226 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.622444 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.622554 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.622831 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.622960 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.623178 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.623332 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.623523 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.623612 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.623869 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.623973 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.624206 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.624310 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.624576 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.624690 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.624974 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.625078 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.625324 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.625427 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.625670 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.625789 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.626016 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.626119 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.626363 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.626466 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.626708 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.626819 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.627614 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.627719 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.628031 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.628134 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.628396 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.628507 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.628788 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.628896 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.629170 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.629273 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.629513 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.629635 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.629859 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.629962 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.630230 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.630333 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.630498 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85691) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:20:05.630604 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.630911 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.631256 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.631614 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.631965 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.632322 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.632727 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.633079 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.633448 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.633799 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.634167 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.634517 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.634885 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.635252 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.635605 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.635956 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.636335 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.636688 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.637090 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.637447 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.637797 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.638151 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.638504 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.638877 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.639248 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.639593 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.639962 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.640322 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.640684 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.641065 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.641420 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.641816 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.642148 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.642581 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.642941 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.643296 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.643654 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.644016 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.644367 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.644763 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.645136 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.645506 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.645902 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.646258 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.646649 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.647026 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:20:05.647306 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85690) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:20:05.665943 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85691) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:05.683467 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:06.005309 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.context [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3be5d8b8-8cd8-4f91-931a-f0226a33b3ec(cell1) {{(pid=85691) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:20:06.010779 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.012696 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.013585 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.015661 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.027444 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.context [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3be5d8b8-8cd8-4f91-931a-f0226a33b3ec(cell1) {{(pid=85690) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:20:06.032978 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85690) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.035637 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=85690) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.036520 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85690) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:20:06.038940 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85690) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:20:06.040772 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85691) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:06.042560 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85691) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:06.062376 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:06.070916 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:06.072326 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85691) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:06.096534 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_db.sqlalchemy.engines [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:20:06.170501 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:20:06.170501 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: from cryptography.utils import int_from_bytes Apr 20 19:20:06.170888 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:20:06.170888 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: from cryptography.utils import int_from_bytes Apr 20 19:20:06.178897 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:20:06.178897 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: from cryptography.utils import int_from_bytes Apr 20 19:20:06.179275 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:20:06.179275 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: from cryptography.utils import int_from_bytes Apr 20 19:20:06.250151 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Loading Gnome Apr 20 19:20:06.257217 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Loading Gnome Apr 20 19:20:06.271907 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Loading Google Apr 20 19:20:06.275389 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Loading Windows (alt) Apr 20 19:20:06.278307 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Loading Google Apr 20 19:20:06.280017 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Loading file Apr 20 19:20:06.281160 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Loading keyczar Apr 20 19:20:06.281606 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Loading multi Apr 20 19:20:06.281710 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Loading Windows (alt) Apr 20 19:20:06.282484 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Loading pyfs Apr 20 19:20:06.286832 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Loading file Apr 20 19:20:06.288092 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Loading keyczar Apr 20 19:20:06.288840 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Loading multi Apr 20 19:20:06.289716 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO keyring.backend [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Loading pyfs Apr 20 19:20:06.569094 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:20:06.571066 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:20:06.576080 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:20:06.578237 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:20:06.910635 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:20:06.916496 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:20:06.920342 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:20:06.922863 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558df28399c0 pid: 85690 (default app) Apr 20 19:20:06.925733 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:20:06.926908 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] 10.222.0.38 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001838 Apr 20 19:20:06.927019 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WARNING keystonemiddleware.auth_token [None req-4ec741e2-f308-4a0c-9937-44a18fd4489b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:20:06.927351 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 1/1] 10.222.0.38 () {50 vars in 779 bytes} [Tue Apr 20 19:20:06 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:20:06.933358 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558df28399c0 pid: 85691 (default app) Apr 20 19:21:32.624769 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:32.626576 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Apr 20 19:21:32.626996 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 2/2] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:33.123699 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c58da959-f7ce-4498-a6d3-e42e381255f4 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:33.151836 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c58da959-f7ce-4498-a6d3-e42e381255f4 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.517353 Apr 20 19:21:33.152791 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 1/3] 10.222.0.38 () {60 vars in 1281 bytes} [Tue Apr 20 19:21:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:35.662245 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:35.663682 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-ad5c9200-ad3b-4072-be82-f00ebd5b6b27 None None] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001881 Apr 20 19:21:35.664093 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 3/4] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:35.729462 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-174860dc-961b-4f16-a21b-aeeb3e4aebd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:35.753756 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:35.753756 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:21:35.782003 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-174860dc-961b-4f16-a21b-aeeb3e4aebd8 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111133 Apr 20 19:21:35.782936 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 2/5] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:35 2021] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:36.073156 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-5f090a12-d701-49b4-85c5-29dd4499de91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:36.079638 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:36.079638 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:21:36.148504 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-5f090a12-d701-49b4-85c5-29dd4499de91 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.356042 Apr 20 19:21:36.149313 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 4/6] 10.222.0.38 () {64 vars in 1325 bytes} [Tue Apr 20 19:21:35 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:38.672418 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-174860dc-961b-4f16-a21b-aeeb3e4aebd8 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:38.674250 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-174860dc-961b-4f16-a21b-aeeb3e4aebd8 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002384 Apr 20 19:21:38.674888 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 3/7] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:38 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:38.800311 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-a1f8c957-c26d-472d-984a-8426a24378a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "ram": 512}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:38.823557 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:38.823557 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:21:38.848387 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-a1f8c957-c26d-472d-984a-8426a24378a5 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166344 Apr 20 19:21:38.849082 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 5/8] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:38.862308 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-6db75f64-78ad-49a6-9e3e-a5994bc38436 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:38.863947 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:21:38.863947 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:21:38.901744 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-6db75f64-78ad-49a6-9e3e-a5994bc38436 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044194 Apr 20 19:21:38.902349 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 4/9] 10.222.0.38 () {64 vars in 1325 bytes} [Tue Apr 20 19:21:38 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:41.481686 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-a1f8c957-c26d-472d-984a-8426a24378a5 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:41.482845 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-a1f8c957-c26d-472d-984a-8426a24378a5 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Apr 20 19:21:41.483412 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 6/10] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:41 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:41.557999 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c2156fba-5db2-4d58-bb3e-daf86db76287 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:41.584672 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c2156fba-5db2-4d58-bb3e-daf86db76287 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094108 Apr 20 19:21:41.589270 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 5/11] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:41.599990 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-cc361eff-59e9-4f52-a4e8-146702e894d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:41.641577 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-cc361eff-59e9-4f52-a4e8-146702e894d7 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045492 Apr 20 19:21:41.642250 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 7/12] 10.222.0.38 () {64 vars in 1325 bytes} [Tue Apr 20 19:21:41 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:44.208804 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c2156fba-5db2-4d58-bb3e-daf86db76287 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:44.209795 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c2156fba-5db2-4d58-bb3e-daf86db76287 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Apr 20 19:21:44.210442 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 6/13] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:44.275265 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-dc88a539-16cf-411f-bad2-2262945eb3dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:44.299884 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-dc88a539-16cf-411f-bad2-2262945eb3dd admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081338 Apr 20 19:21:44.306126 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 8/14] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:44.314589 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c6726a33-764d-44ea-be7b-eabadd57c78b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:44.350304 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c6726a33-764d-44ea-be7b-eabadd57c78b admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040370 Apr 20 19:21:44.350922 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 7/15] 10.222.0.38 () {64 vars in 1325 bytes} [Tue Apr 20 19:21:44 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:46.885927 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-dc88a539-16cf-411f-bad2-2262945eb3dd admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:46.887897 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-dc88a539-16cf-411f-bad2-2262945eb3dd admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002483 Apr 20 19:21:46.888438 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 9/16] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:46 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:46.954467 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-b5df0cf7-eec7-40ae-ae2d-2f552aa89e52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "disk": 20, "ram": 4096}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:46.979558 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-b5df0cf7-eec7-40ae-ae2d-2f552aa89e52 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083080 Apr 20 19:21:46.980141 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 8/17] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:46.994017 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-f12e3546-e96f-466c-8138-27a7102ccbe9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:47.029896 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-f12e3546-e96f-466c-8138-27a7102ccbe9 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039697 Apr 20 19:21:47.030900 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 10/18] 10.222.0.38 () {64 vars in 1325 bytes} [Tue Apr 20 19:21:46 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:49.927518 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-b5df0cf7-eec7-40ae-ae2d-2f552aa89e52 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:49.929134 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-b5df0cf7-eec7-40ae-ae2d-2f552aa89e52 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Apr 20 19:21:49.929817 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 9/19] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:49 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:21:50.002495 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-7c149453-1696-45e8-a7da-ec5681bd5eac admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:50.029871 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-7c149453-1696-45e8-a7da-ec5681bd5eac admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091058 Apr 20 19:21:50.030509 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 11/20] 10.222.0.38 () {60 vars in 1281 bytes} [Tue Apr 20 19:21:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:21:52.721900 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-b5df0cf7-eec7-40ae-ae2d-2f552aa89e52 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:52.723035 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-b5df0cf7-eec7-40ae-ae2d-2f552aa89e52 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Apr 20 19:21:52.723488 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 10/21] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:52 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:52.805405 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-d7e4b045-fefb-4e69-ae9d-6ce26b1c9cdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "id": "1", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:52.835525 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-d7e4b045-fefb-4e69-ae9d-6ce26b1c9cdb admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.103197 Apr 20 19:21:52.836133 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 12/22] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:52 2021] POST /compute/v2.1/flavors => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:52.854714 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-cf9dd406-b5cb-4356-ab39-7de8f075fbe9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:52.908526 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-cf9dd406-b5cb-4356-ab39-7de8f075fbe9 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059564 Apr 20 19:21:52.909383 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 11/23] 10.222.0.38 () {64 vars in 1322 bytes} [Tue Apr 20 19:21:52 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:55.646909 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-d7e4b045-fefb-4e69-ae9d-6ce26b1c9cdb admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:55.647970 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-d7e4b045-fefb-4e69-ae9d-6ce26b1c9cdb admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Apr 20 19:21:55.648518 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 13/24] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:55.708882 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-ea0febe5-1ac4-4e0c-9c8d-71d9349f09c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2"}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:55.734532 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-ea0febe5-1ac4-4e0c-9c8d-71d9349f09c9 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079563 Apr 20 19:21:55.735056 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 12/25] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:55.748535 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-87e71d83-1b3a-44fb-85f5-3c8065d064d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:55.785880 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-87e71d83-1b3a-44fb-85f5-3c8065d064d5 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041339 Apr 20 19:21:55.786506 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 14/26] 10.222.0.38 () {64 vars in 1322 bytes} [Tue Apr 20 19:21:55 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:21:58.316109 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-ea0febe5-1ac4-4e0c-9c8d-71d9349f09c9 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:21:58.317325 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-ea0febe5-1ac4-4e0c-9c8d-71d9349f09c9 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Apr 20 19:21:58.317773 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 13/27] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:21:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:21:58.376960 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-b3ca1339-85db-401c-a0c2-3f6eaac49503 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:58.403092 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-b3ca1339-85db-401c-a0c2-3f6eaac49503 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078657 Apr 20 19:21:58.403698 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 15/28] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:21:58 2021] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:21:58.417396 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-f1521a81-bef1-4967-9123-14c504b701a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:21:58.456549 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-f1521a81-bef1-4967-9123-14c504b701a3 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043031 Apr 20 19:21:58.457188 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 14/29] 10.222.0.38 () {64 vars in 1322 bytes} [Tue Apr 20 19:21:58 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:00.994233 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-b3ca1339-85db-401c-a0c2-3f6eaac49503 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:00.995921 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-b3ca1339-85db-401c-a0c2-3f6eaac49503 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Apr 20 19:22:00.996548 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 16/30] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:22:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:01.063564 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-665c570c-2655-4ad2-b646-d2601e8aa7f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "id": "4", "disk": 80}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:01.092464 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-665c570c-2655-4ad2-b646-d2601e8aa7f9 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088480 Apr 20 19:22:01.093370 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 15/31] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:22:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:22:01.107850 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c12a5e33-aada-4f28-87c4-5fcb364b3349 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:01.149493 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c12a5e33-aada-4f28-87c4-5fcb364b3349 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045584 Apr 20 19:22:01.161034 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 17/32] 10.222.0.38 () {64 vars in 1322 bytes} [Tue Apr 20 19:22:01 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:03.759601 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-665c570c-2655-4ad2-b646-d2601e8aa7f9 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:03.760677 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-665c570c-2655-4ad2-b646-d2601e8aa7f9 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Apr 20 19:22:03.761323 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 16/33] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:22:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:03.827123 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-7b765097-b0e4-4c33-81ed-96e697e6ff43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:03.852322 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-7b765097-b0e4-4c33-81ed-96e697e6ff43 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084142 Apr 20 19:22:03.854414 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 18/34] 10.222.0.38 () {64 vars in 1272 bytes} [Tue Apr 20 19:22:03 2021] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:22:03.867297 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-0d817969-1ec1-4291-a2c0-169456605516 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:03.903628 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-0d817969-1ec1-4291-a2c0-169456605516 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040681 Apr 20 19:22:03.904505 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 17/35] 10.222.0.38 () {64 vars in 1322 bytes} [Tue Apr 20 19:22:03 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:22:44.921340 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-7b765097-b0e4-4c33-81ed-96e697e6ff43 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:44.922410 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-7b765097-b0e4-4c33-81ed-96e697e6ff43 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Apr 20 19:22:44.922835 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 19/36] 10.222.0.38 () {54 vars in 920 bytes} [Tue Apr 20 19:22:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:44.982737 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-88e81988-302d-44f3-a780-586a4e7dee4d admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:45.008099 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-88e81988-302d-44f3-a780-586a4e7dee4d admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078991 Apr 20 19:22:45.008673 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 18/37] 10.222.0.38 () {60 vars in 1281 bytes} [Tue Apr 20 19:22:44 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:46.685079 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-7b765097-b0e4-4c33-81ed-96e697e6ff43 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.686220 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-7b765097-b0e4-4c33-81ed-96e697e6ff43 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Apr 20 19:22:46.686675 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 20/38] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:46.868114 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-2addb5a1-09ee-45c1-a242-f04e3ba99de9 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.883516 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.wsgi [None req-2addb5a1-09ee-45c1-a242-f04e3ba99de9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 19:22:46.884140 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-2addb5a1-09ee-45c1-a242-f04e3ba99de9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:46.885016 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-2addb5a1-09ee-45c1-a242-f04e3ba99de9 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.070442 Apr 20 19:22:46.885565 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 19/39] 10.222.0.38 () {60 vars in 1181 bytes} [Tue Apr 20 19:22:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:22:46.896593 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-56864026-b062-4f50-9c8a-438c0c395490 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.918063 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-56864026-b062-4f50-9c8a-438c0c395490 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025368 Apr 20 19:22:46.918617 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 21/40] 10.222.0.38 () {60 vars in 1201 bytes} [Tue Apr 20 19:22:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:46.929232 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-ceda7f2a-a036-40a2-980a-fa05f44a935a admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.951414 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-ceda7f2a-a036-40a2-980a-fa05f44a935a admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025881 Apr 20 19:22:46.953056 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 20/41] 10.222.0.38 () {60 vars in 1201 bytes} [Tue Apr 20 19:22:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:46.962866 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-d310c69d-1620-4d82-b994-389d4203573e admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:46.976666 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.wsgi [None req-d310c69d-1620-4d82-b994-389d4203573e admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 19:22:46.977322 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-d310c69d-1620-4d82-b994-389d4203573e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:46.978215 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-d310c69d-1620-4d82-b994-389d4203573e admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019177 Apr 20 19:22:46.978757 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 22/42] 10.222.0.38 () {60 vars in 1181 bytes} [Tue Apr 20 19:22:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:22:48.546290 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-ceda7f2a-a036-40a2-980a-fa05f44a935a admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:48.547366 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-ceda7f2a-a036-40a2-980a-fa05f44a935a admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Apr 20 19:22:48.547796 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 21/43] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:48.728848 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c9ce4113-433a-404e-806b-7f7efa22a719 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:48.742136 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.wsgi [None req-c9ce4113-433a-404e-806b-7f7efa22a719 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 19:22:48.742742 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c9ce4113-433a-404e-806b-7f7efa22a719 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:48.743586 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c9ce4113-433a-404e-806b-7f7efa22a719 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.068656 Apr 20 19:22:48.744112 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 23/44] 10.222.0.38 () {60 vars in 1181 bytes} [Tue Apr 20 19:22:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:22:48.755015 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-3c7c8fb0-e8dd-4ad0-9a49-11550a8d9471 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:48.776448 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-3c7c8fb0-e8dd-4ad0-9a49-11550a8d9471 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025353 Apr 20 19:22:48.777048 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 22/45] 10.222.0.38 () {60 vars in 1201 bytes} [Tue Apr 20 19:22:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:48.787572 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c7936acf-7056-4148-bab3-b07c1f295e27 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:48.809207 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c7936acf-7056-4148-bab3-b07c1f295e27 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025615 Apr 20 19:22:48.809761 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 24/46] 10.222.0.38 () {60 vars in 1201 bytes} [Tue Apr 20 19:22:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:48.820224 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-771386b7-27b2-4d47-b51a-153ce584c7b1 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:48.833501 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.wsgi [None req-771386b7-27b2-4d47-b51a-153ce584c7b1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 19:22:48.834122 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-771386b7-27b2-4d47-b51a-153ce584c7b1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:48.834964 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-771386b7-27b2-4d47-b51a-153ce584c7b1 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018599 Apr 20 19:22:48.835508 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 23/47] 10.222.0.38 () {60 vars in 1181 bytes} [Tue Apr 20 19:22:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:22:50.426590 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-c7936acf-7056-4148-bab3-b07c1f295e27 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:50.427676 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-c7936acf-7056-4148-bab3-b07c1f295e27 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Apr 20 19:22:50.428121 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 25/48] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:50.614540 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-30b98bde-701d-49aa-9819-f920659ad187 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:50.627953 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.wsgi [None req-30b98bde-701d-49aa-9819-f920659ad187 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 19:22:50.628511 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-30b98bde-701d-49aa-9819-f920659ad187 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:50.629399 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-30b98bde-701d-49aa-9819-f920659ad187 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.069064 Apr 20 19:22:50.629946 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 24/49] 10.222.0.38 () {60 vars in 1184 bytes} [Tue Apr 20 19:22:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:22:50.640612 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-a7e8d3f2-5a87-49ec-9b32-7fbfcd8b7605 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:50.662159 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-a7e8d3f2-5a87-49ec-9b32-7fbfcd8b7605 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026118 Apr 20 19:22:50.662983 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 26/50] 10.222.0.38 () {60 vars in 1201 bytes} [Tue Apr 20 19:22:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:22:50.673317 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:50.695311 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026058 Apr 20 19:22:50.695867 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 25/51] 10.222.0.38 () {60 vars in 1201 bytes} [Tue Apr 20 19:22:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:22:50.705749 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-236c52ff-7687-4706-ab7d-381b709a7e2e admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:50.718977 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.wsgi [None req-236c52ff-7687-4706-ab7d-381b709a7e2e admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 19:22:50.719598 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-236c52ff-7687-4706-ab7d-381b709a7e2e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:22:50.720433 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-236c52ff-7687-4706-ab7d-381b709a7e2e admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018615 Apr 20 19:22:50.721012 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 27/52] 10.222.0.38 () {60 vars in 1184 bytes} [Tue Apr 20 19:22:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 19:22:52.297044 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:52.298185 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Apr 20 19:22:52.298610 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 26/53] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:52.486660 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-abf44ddc-8e5c-496f-af7c-18d13b6f4434 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:52.510040 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-abf44ddc-8e5c-496f-af7c-18d13b6f4434 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.080967 Apr 20 19:22:52.510618 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 28/54] 10.222.0.38 () {64 vars in 1226 bytes} [Tue Apr 20 19:22:52 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:22:54.086570 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:54.087659 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Apr 20 19:22:54.088065 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 27/55] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:54.275659 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9d938025-58f0-47c7-bc90-a39d758e5421 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:54.300270 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9d938025-58f0-47c7-bc90-a39d758e5421 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.079093 Apr 20 19:22:54.300818 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 29/56] 10.222.0.38 () {64 vars in 1226 bytes} [Tue Apr 20 19:22:54 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:22:55.872143 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:55.873762 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Apr 20 19:22:55.874236 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 28/57] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:56.056324 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-edf58d9a-0fbb-4957-99ca-6bf70910b800 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:56.080658 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-edf58d9a-0fbb-4957-99ca-6bf70910b800 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.077798 Apr 20 19:22:56.081204 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 30/58] 10.222.0.38 () {64 vars in 1226 bytes} [Tue Apr 20 19:22:56 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:22:57.662103 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:57.663524 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001827 Apr 20 19:22:57.663946 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 29/59] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:57.846135 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-b5924259-df9b-42db-8508-08f72f53319d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:22:57.874286 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-b5924259-df9b-42db-8508-08f72f53319d admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.081342 Apr 20 19:22:57.874882 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 31/60] 10.222.0.38 () {64 vars in 1226 bytes} [Tue Apr 20 19:22:57 2021] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:22:59.478859 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:59.479913 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Apr 20 19:22:59.480341 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 30/61] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:22:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:22:59.660988 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-3a21a99b-7643-4d3a-9d3d-6915ab01b6e2 admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:22:59.689442 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-3a21a99b-7643-4d3a-9d3d-6915ab01b6e2 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082647 Apr 20 19:22:59.690019 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 32/62] 10.222.0.38 () {60 vars in 1193 bytes} [Tue Apr 20 19:22:59 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:23:51.035316 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:51.036373 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-9cf814f6-46a4-4ad4-b80b-164f6d200263 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Apr 20 19:23:51.037090 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 31/63] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:23:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:23:51.221978 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:23:51.249898 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.083021 Apr 20 19:23:51.250472 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 33/64] 10.222.0.38 () {60 vars in 1193 bytes} [Tue Apr 20 19:23:51 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:25:17.556017 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-eabf3706-5205-408d-bf2c-f50fd399b406 tempest-verify_tempest_config-243662018 tempest-verify_tempest_config-243662018-project] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:25:17.558425 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-eabf3706-5205-408d-bf2c-f50fd399b406 tempest-verify_tempest_config-243662018 tempest-verify_tempest_config-243662018-project] 10.222.0.38 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121725 Apr 20 19:25:17.558999 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 32/65] 10.222.0.38 () {58 vars in 1124 bytes} [Tue Apr 20 19:25:17 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:26:54.101471 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:54.102552 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Apr 20 19:26:54.103028 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 34/66] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:26:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:26:54.367316 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-101709c5-11e8-49f8-87bb-91b7eb3a054d admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:54.368612 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:26:54.368612 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:26:54.370508 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-101709c5-11e8-49f8-87bb-91b7eb3a054d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:54.371000 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-101709c5-11e8-49f8-87bb-91b7eb3a054d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:54.371842 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-101709c5-11e8-49f8-87bb-91b7eb3a054d admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:54.372314 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-101709c5-11e8-49f8-87bb-91b7eb3a054d admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:54.405491 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-101709c5-11e8-49f8-87bb-91b7eb3a054d admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.167194 Apr 20 19:26:54.406089 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 33/67] 10.222.0.38 () {60 vars in 1184 bytes} [Tue Apr 20 19:26:54 2021] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:26:56.016960 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:56.018068 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Apr 20 19:26:56.018497 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 35/68] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:26:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:26:56.206177 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-4c03d23f-4c05-48da-95c2-6419fab6c0dc admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:26:56.207470 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:26:56.207470 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:26:56.209098 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4c03d23f-4c05-48da-95c2-6419fab6c0dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:56.209582 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4c03d23f-4c05-48da-95c2-6419fab6c0dc admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:56.210457 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4c03d23f-4c05-48da-95c2-6419fab6c0dc admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:26:56.210922 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-4c03d23f-4c05-48da-95c2-6419fab6c0dc admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:26:56.236411 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-4c03d23f-4c05-48da-95c2-6419fab6c0dc admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.086562 Apr 20 19:26:56.236963 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 34/69] 10.222.0.38 () {60 vars in 1184 bytes} [Tue Apr 20 19:26:56 2021] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:27:08.275934 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:27:08.277023 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Apr 20 19:27:08.277451 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 36/70] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:27:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:27:08.465369 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-b5d79d15-e994-4a63-9122-c81d4349905f admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:27:08.466662 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:27:08.466662 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:27:08.468358 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-b5d79d15-e994-4a63-9122-c81d4349905f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:27:08.468906 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-b5d79d15-e994-4a63-9122-c81d4349905f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:27:08.469738 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-b5d79d15-e994-4a63-9122-c81d4349905f admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:27:08.470209 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-b5d79d15-e994-4a63-9122-c81d4349905f admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:27:08.503672 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-b5d79d15-e994-4a63-9122-c81d4349905f admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.095913 Apr 20 19:27:08.504261 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 35/71] 10.222.0.38 () {60 vars in 1184 bytes} [Tue Apr 20 19:27:08 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:27:10.074038 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] Calling method '>' {{(pid=85690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:27:10.075094 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-623aa3f5-c152-4ba9-b91f-75df0cd8d70a admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Apr 20 19:27:10.075516 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85690|app: 0|req: 37/72] 10.222.0.38 () {56 vars in 1065 bytes} [Tue Apr 20 19:27:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:27:10.258934 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG nova.api.openstack.wsgi [None req-03599fc5-9c12-4d35-9e3a-faf41a365782 admin admin] Calling method '>' {{(pid=85691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:27:10.260916 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:27:10.260916 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: warnings.warn(msg) Apr 20 19:27:10.262557 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-03599fc5-9c12-4d35-9e3a-faf41a365782 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:27:10.263052 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-03599fc5-9c12-4d35-9e3a-faf41a365782 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:27:10.263892 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-03599fc5-9c12-4d35-9e3a-faf41a365782 admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:27:10.264363 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: DEBUG oslo_concurrency.lockutils [None req-03599fc5-9c12-4d35-9e3a-faf41a365782 admin admin] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85691) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:27:10.292255 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: INFO nova.api.openstack.requestlog [None req-03599fc5-9c12-4d35-9e3a-faf41a365782 admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.087707 Apr 20 19:27:10.292807 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: [pid: 85691|app: 0|req: 36/73] 10.222.0.38 () {60 vars in 1184 bytes} [Tue Apr 20 19:27:10 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:28:08.753374 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: Tue Apr 20 19:28:08 2021 - graceful shutdown triggered... Apr 20 19:28:08.753427 dv-cinder-787264-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 20 19:28:08.754372 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: Gracefully killing worker 1 (pid: 85690)... Apr 20 19:28:08.754683 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: Gracefully killing worker 2 (pid: 85691)... Apr 20 19:28:09.753510 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: worker 1 buried after 1 seconds Apr 20 19:28:09.753510 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: worker 2 buried after 1 seconds Apr 20 19:28:09.753510 dv-cinder-787264-1-iscsi devstack@n-api.service[85689]: goodbye to uWSGI. Apr 20 19:28:09.755280 dv-cinder-787264-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 20 19:28:09.757009 dv-cinder-787264-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 19:28:09.765347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 19:28:09 2021] *** Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: nodename: dv-cinder-787264-1-iscsi Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: machine: x86_64 Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: clock source: unix Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: pcre jit disabled Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: detected number of CPU cores: 4 Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: current working directory: / Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: detected binary path: /usr/bin/uwsgi-core Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: dropping root privileges as early as possible Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: your processes number limit is 47843 Apr 20 19:28:09.767338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: your memory page size is 4096 bytes Apr 20 19:28:09.768527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: detected max file descriptor number: 2048 Apr 20 19:28:09.768527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: lock engine: pthread robust mutexes Apr 20 19:28:09.768527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: thunder lock: enabled Apr 20 19:28:09.768527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 19:28:09.768527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: dropping root privileges after socket binding Apr 20 19:28:09.768527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 19:28:09.814071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Python main interpreter initialized at 0x5574d85af9c0 Apr 20 19:28:09.814071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: dropping root privileges after plugin initialization Apr 20 19:28:09.814071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: python threads support enabled Apr 20 19:28:09.814071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: your server socket listen backlog is limited to 100 connections Apr 20 19:28:09.814071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: your mercy for graceful operations on workers is 90 seconds Apr 20 19:28:09.814626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 19:28:09.814626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: *** Operational MODE: preforking *** Apr 20 19:28:09.814814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: dropping root privileges after application loading Apr 20 19:28:09.814814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: *** uWSGI is running in multiple interpreter mode *** Apr 20 19:28:09.814814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: spawned uWSGI master process (pid: 100561) Apr 20 19:28:09.814896 dv-cinder-787264-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 19:28:09.815270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: spawned uWSGI worker 1 (pid: 100562, cores: 1) Apr 20 19:28:09.815530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: spawned uWSGI worker 2 (pid: 100563, cores: 1) Apr 20 19:28:09.815650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 19:28:15.048915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:28:15.049630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:28:15.050848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:28:15.051313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:28:15.051613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:28:15.052093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.052470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.052893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.053264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.053653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.054012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.054385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.054753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.055201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.055532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.055874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.056258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787264-1-iscsi {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.056848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.057022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.057348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.057731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.058086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.058458 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.058812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.059455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.059814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.060169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.060527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.061075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.061301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.061659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.062040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.062396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.062777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.063136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.063512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787264-1-iscsi {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.063884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.064243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.064607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.065159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.065516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.065872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.066249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.066626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.066982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.067370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.067739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.068111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.068484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.068864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.069224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.069579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.069950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.070300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.071210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.071526 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.071890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.072270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.072637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.073054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.073348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.073642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.074015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.074391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.074752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.075107 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.075460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.075814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.076167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.076517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.076895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.077249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.077623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.077992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.078372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.078725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.079098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.079575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.079866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.080222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.080623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.081026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.081386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.081768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.082140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.082497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.082853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.083185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.083563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.083939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.084292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.084584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.084964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.085319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.085688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.086040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.086944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.088233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.088233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.088233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.088759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.088759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.089100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.089451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.089803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.090153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.090506 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.090857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.091237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.091613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.091974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.092328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.092679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.093057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.093429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.093781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.094133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.094512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.094864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.095215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.095586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.095937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.096288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.096656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.097031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.097383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.097754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.098106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.098457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.098807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.099157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.099509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.099857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.100204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.100552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.100934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.101300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.101683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.102247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.102712 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.103073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.103439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.103833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.104218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.104615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.105026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.105417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.105798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.106164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.106523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.106883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.107261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.107617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.107973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.108330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.108734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.109092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.109484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.109847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.110216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.110559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.111146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.111516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.111898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.112274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.112661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.113092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.113470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.113834 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.114272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.114549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.114923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.115289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.115650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.116008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.116372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.116803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.118820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.118820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.118820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.118820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.118820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.118820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.119537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.119537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.119831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.120214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.120592 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.121104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.121506 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.121862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.122220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.122577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.122932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.123288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.123645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.123996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.124370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.124754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.125108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.125479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.125833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.126184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.126547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.126905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.127265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.127620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.127997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.128357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.128750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.129126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.129518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.129869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.130248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.130620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.130982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.131330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.131432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 19:28:15.131643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 19:28:15.131754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.132018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.132369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.132767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.133608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.133995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.134107 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 19:28:15.134348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.134692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 19:28:15.134805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.134995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 19:28:15.135148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.135358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.135475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.135733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.135837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.136087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.136198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.136438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.136549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.136812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.136929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.137162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.137312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.137555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.137667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.137898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.138010 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.138275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.138379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.138578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.138683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.138943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.139052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.139303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.139414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787264-1-iscsi {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.139658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.139768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.140004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.140146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.140413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.140533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.140644 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.140783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.141055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.141182 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.141405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.141518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.141748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.141861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.142096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.142384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.142505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.142740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.142852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.143096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.143217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.143456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.143572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.143814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.143928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.144183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.144297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.144532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.144661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.144913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.145020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.145261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.145496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.145608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.145759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.145929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.146016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.146288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.146374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787264-1-iscsi {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.146655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.146760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.147007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.147099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.147363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.147456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.147707 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.147855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.148069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.148214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.148424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.148511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.149026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.149166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.149281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.149625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.149860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.149983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.150199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.150351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.150603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.150761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.150863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.151076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.151208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.151324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.151437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.151673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.151780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.152116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.152282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.152472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.152650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.152879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.153057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.153235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.153357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.153587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.153704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.153877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.154054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.154231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.154414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.154602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.154759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.154987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.155145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.155378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.155474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.155671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.155768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.156002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.156117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.156348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.156489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.156767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.156874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.157126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.157247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.157478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.157582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.157821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.157924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.158173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.158277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.158516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.158627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.158862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.158994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.159187 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.159290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.159568 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.159668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.159898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.160000 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.160250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.160362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.160893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.161013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.161242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.161358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.161594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.161699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.161967 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.162100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.162373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.162676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.162801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.163034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.163176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.163457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.163684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.163864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.164058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.164155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.164943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.165057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.165323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.165674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.165795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.166039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.166140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.166392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.166500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.166745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.166849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.167103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.167205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.167450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.167565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.167747 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.167892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.168091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.168200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.168442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.168548 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.168819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.168928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.169165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.169282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.169513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.169619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.169856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.169960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.170198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.170309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.170541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.170653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.170885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.170990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.171228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.171338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.171572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.171696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.171911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.172014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.172257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.172369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.172606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.172748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.172982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.173088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.173324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.173436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.173665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.173769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.174014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.174126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.174366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.174479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.174718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.174823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.175069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.175173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.175420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.175532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.175790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.175894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.176140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.176250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.176484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.176596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.176872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.176980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.177220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.177338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.177560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.177666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.177911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.178039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.178254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.178365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.178594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.178704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.178951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.179062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.179287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.179392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.179635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.179747 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.179994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.180131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.180387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.180588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.180900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.181066 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.181272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.181422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.181628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.181759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.181981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.182097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.182333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.182414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.182665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.182777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.183020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.183130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.183368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.183479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.183734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.183847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.184084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.184194 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.184433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.184536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.184843 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.184955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.185152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.185245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.185502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.185858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.186202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 19:28:15.186297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.186567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.186652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.186915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.187001 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.187326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.187424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.187598 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.187691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.187946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.188037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.188295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.188482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.188654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.189056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.189344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.189487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.189727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.189988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.190162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.190363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.190481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.190743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.190830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.191136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.191407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.191582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.191785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.191955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.192123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.192295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.192460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.192609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.192853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.193032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.193188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.193188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.193494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.193659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.193832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.193995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.194152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.194317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.194471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.194625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.194786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.194941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.195108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.195261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.195425 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.195578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.196331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.196525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.196637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.196957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.197224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.197337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.197593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.197699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.197975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.198079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.198326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.198438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.198697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.198808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.199060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.199176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.199421 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.199522 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.199765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.199869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.200120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.200223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.200473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.200584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.200855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.200974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.201212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.201316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.201569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.201689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.201926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.202035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.202279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.202389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.202628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.202744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.202970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.203075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.203320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.203468 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.203665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.203771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.204014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.204119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.204370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.204481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.204765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.204885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.205112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.205224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.205456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.205566 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.205799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.205909 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.206149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.206252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.206494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.206609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.206850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.206984 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.207187 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.207291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.207540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.207673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.207915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.208039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.208273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.208401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.208626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.208809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.209034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.209163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.209390 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.209512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.209743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.209879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.210101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.210224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.210452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.210573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.210811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.210949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.211168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.211297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.212235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.212373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.212670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.213060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.213453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.213849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.214203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.214584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.214962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.215330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.215682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.216042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.216396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.216771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.217128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.217242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.217487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.217601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.217838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.217942 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.218188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.218299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.218539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.218643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.218893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.219005 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.219246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.219348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.219622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.219731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.219973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.220084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.220332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.220435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.220682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.220838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.221037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.221210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.221439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.221541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.221792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.221894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.222184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.222314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.222971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223322 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.223978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.224062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.224192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.224487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.224583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.224839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.224951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.225135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.225242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.225477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.225587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.225857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.225960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.226215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.226330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.226666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.226779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.227102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.227284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.227451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.227608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.227761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.227983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.228145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.228356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.228525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.228687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.228906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.229071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.229224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.229383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.229554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.229716 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.229876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.230035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.230256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.230430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.230583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.230737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.230934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.231100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.231265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.231430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.231621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.231793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.231954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.232106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.232325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.232515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.233190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.233457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.233657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.233824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.233993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.234160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.234315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.234476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.234476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.234774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.234934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.235099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.235253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.235405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.235555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.235713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.235874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.236036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.236197 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.236357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.236526 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.236884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.237065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.237219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.237379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.237533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.237685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.237842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.238008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.238163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.238315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.238467 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.238618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.238785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.238954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.239115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.239270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.239422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.239580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.239743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.239896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.240054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.240216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.240368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.240520 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.240679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.240880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.241046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.241212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.241371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.241524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.241685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.241837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.241996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.242148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.242300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.242451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.243657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.243833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.243987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.244147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.244307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.244470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.244470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.244791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.245101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.245263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.245417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.245582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.245744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.245904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.246076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.246242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.246395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.246560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.246713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.246713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.247166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.247321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.247473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.247638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.247798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.247957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.248115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.248285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.248450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.248604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.248799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.248961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.249114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.249266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.249442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.249602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.249763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.249916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.250073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.250350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.250564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.250741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.250904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.250904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.251210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.251372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.251533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.251686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.251837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.251996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.252155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.252315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.252477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.252636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.252834 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.252989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.253583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.253867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.254035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.254188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.254347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.254500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.254652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.254816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.254969 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.255218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.255379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.255531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.255683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.255848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.256010 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.256163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.256163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.256468 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.256630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.256850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.257157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.257319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.257482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.257634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.257857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.258021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.258317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259000 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.259935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.260251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.260479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.260643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.260853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261336 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.261931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.262246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.262405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.262557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.262717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.262877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.263038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.263218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.263696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.264050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.264220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.264376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.264538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.264538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.264898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.265052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.265222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.265462 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.265630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.265783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.265783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.266078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.266231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.266231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.266534 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.266696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.266855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.267008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.267313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.267481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.267642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.267642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.267940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.268100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.268258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.268424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.268578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.268770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.268942 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.269104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.269333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.269503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.269718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.269879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.270077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.270335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.270505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.270793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.270962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.271122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.271292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.271470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.271639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.271798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.271958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.272111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.272263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.272456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.272835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.273135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.273306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.273826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.274022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.274401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.274401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.274696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.274856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.275016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.275175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.275337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.275587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.275756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.275919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.276072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.276232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.276398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.276561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.276761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.276926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.277079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.277249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.277574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.277881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.278057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.278223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.278391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.278552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.278705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.278864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.279029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.279182 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.279335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.279494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.279647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.279799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.279957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.280117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.280277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.280439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.280641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.280846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.281001 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.281164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.281359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.281532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.281686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.281852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.282046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.282214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.282367 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.282529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.282727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.282894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.283047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.283209 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.283369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.283521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.284073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.284258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.284725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.284949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.285115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.285269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.285429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.285606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.286099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.286261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.286435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.286597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.286751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.286916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.287069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.287221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.287375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.287696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.287858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.288019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.288173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.288327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.288480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.288642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.288831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.288998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.289152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.289311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.289678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.289913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.290091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.290330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.290589 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.290811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.290974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.291251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.291481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.291481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.291781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.291941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.292101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.292264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.292430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.292591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.292797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.292958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.293111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.293264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.293437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.293591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.293761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.294249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.294431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.294773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.294942 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.295105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.295258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.295258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.295258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.295683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.295846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.296024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.296272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.296438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.296603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.296813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.297048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.297212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.297365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.297525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.297843 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.298019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.298178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.298334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.298497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.298650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.298802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.299002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.299163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.299315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.299479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.299633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.299796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.299950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.300102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.300261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.300431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.300591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.300830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.300998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.301153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.301305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.301305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.301613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.301778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.301939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.302099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.302255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.302407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.302634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.302797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.302957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.303111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.303270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.303430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.303596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.303766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.303929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.304404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.304578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.304935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.305646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.305871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.306129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.306129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.306676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.306847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.307014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.307177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.307331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.307491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.307652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.307984 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.308147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.308147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.308451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.308611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.308788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.308961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.309116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.309280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.309434 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.309646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.309801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.309966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.310127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.310287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.310451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.310603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.310755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.311417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.311591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.311746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.311746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.312853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.313309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.313469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.313624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.313783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.313943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.314166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.314652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.314892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.315256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.315419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.315584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.315747 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.315901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.316060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.316219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.316380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.316540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.316869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.317045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.317200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.317360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.317520 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.317682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.317845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.318168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.318330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.318490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.318645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.318809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.318971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.319124 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.319284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.319443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.319596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.319757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.319912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.320081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.320243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.320402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.320569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.321324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.321635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.321808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.321964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.322117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.322281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.322434 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.322585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.322746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.322906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.323071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.323232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.323386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.323537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.323696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.323696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.323985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.324146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.324304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.324474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.324968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.325330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.325506 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.325667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.325828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.325981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.326134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.326295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.326461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.326621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.326798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.327029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.327196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.327367 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.327632 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.327798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.327958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.328275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.328453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.328607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.328796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.328964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.329125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.329285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.329446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.329607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.329769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.329922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.330074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.330233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.330387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.330556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.330709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.330861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.331019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.331286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.331469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.331635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.331799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.331965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.332119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.332271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.332436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.332597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.332813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.332982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.333148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.333310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.333471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.333633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.333787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.333956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.334122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.334276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.334440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.334610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.335126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.335318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.335587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.335867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100563) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.336029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.337863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.337863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.337863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.337863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.338630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.338630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.338630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.339076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.339301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.339660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.340042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.340429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.340840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.341239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.341604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.341968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.342331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.342701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.343127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.343494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.343849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.344217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.344586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.345205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.345382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.345660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.346003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.346368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.346732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.347088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.347450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.347808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.348191 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.348585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.348981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.349336 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.349697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.350072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.350688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.351047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.351432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.351811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.352746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.353113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.353486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.354036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.354370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.354544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.354870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.356848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.356848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.356848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.356848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.356848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.357279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.357279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.358054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.358286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.358647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.359003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.359381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.359746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.360102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.360463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.360946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.361195 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.361559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.361919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.362271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.362620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.362978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.363333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.363686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.364152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.364439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.364831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.365664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.365803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.366067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.366426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.366784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.368173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.368173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.368525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.368990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.369352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.369715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.370071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.370439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.370792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.371157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.371513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.371896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.372252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.372605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.372811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.372993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.373340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.373719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.374092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.374423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.374830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.375197 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.375849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.376244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.376620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.377056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.377712 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.378027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.378415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.378415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.378880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.379130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.379479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.379837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.380199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.380563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.380945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.381304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.381661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.382019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.382377 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.382776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.383170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.383751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.384241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.384610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.384997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.385358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.385718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.386077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.386441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.386827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.387190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.387769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.388029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.388483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.388776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.389168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.389487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.389870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.390263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.390652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.397313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.398679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.400412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.401674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.401674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.401674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.401674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.401674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.402415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.402415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.402415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.402862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.405941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.407198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.407198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.407198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.407198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.407198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.407941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.407941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.408250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.408556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.408939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.409319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.409677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.410040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.410404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.411017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.411382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.411745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.412122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.412499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.416729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.416729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.416729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.416729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.416729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.416729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 19:28:15.416729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100562) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 19:28:15.453022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.646207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.context [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3be5d8b8-8cd8-4f91-931a-f0226a33b3ec(cell1) {{(pid=100563) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:28:15.652218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:15.654112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:15.655218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:15.657424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:15.680542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.687587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.716906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100563) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.731243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.context [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3be5d8b8-8cd8-4f91-931a-f0226a33b3ec(cell1) {{(pid=100562) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 19:28:15.736767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:15.738636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:15.739544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:28:15.741750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:28:15.769307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.772388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.805777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_db.sqlalchemy.engines [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100562) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 19:28:15.809895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:28:15.809895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 20 19:28:15.810307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:28:15.810307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 20 19:28:15.889305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Loading Gnome Apr 20 19:28:15.890701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:28:15.890701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 20 19:28:15.891083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 19:28:15.891083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: from cryptography.utils import int_from_bytes Apr 20 19:28:15.910371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Loading Google Apr 20 19:28:15.914031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Loading Windows (alt) Apr 20 19:28:15.919606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Loading file Apr 20 19:28:15.920790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Loading keyczar Apr 20 19:28:15.921223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Loading multi Apr 20 19:28:15.922119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Loading pyfs Apr 20 19:28:15.975156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Loading Gnome Apr 20 19:28:15.996648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Loading Google Apr 20 19:28:16.000041 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Loading Windows (alt) Apr 20 19:28:16.004954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Loading file Apr 20 19:28:16.006038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Loading keyczar Apr 20 19:28:16.006577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Loading multi Apr 20 19:28:16.007372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO keyring.backend [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Loading pyfs Apr 20 19:28:16.209514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:28:16.217111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:28:16.290907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:28:16.298415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:28:16.558338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:28:16.564168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-9a8a7912-d812-4b84-9ad9-e98ee58ebf55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:28:16.569861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5574d85af9c0 pid: 100563 (default app) Apr 20 19:28:16.638841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 19:28:16.644611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WARNING keystonemiddleware.auth_token [None req-68cfd7f5-f7b4-4244-b719-2b458f20cef7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 19:28:16.651968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5574d85af9c0 pid: 100562 (default app) Apr 20 19:28:54.823626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-86e70509-263c-4d7f-9a2b-d3bed330657d tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Action: 'create', calling method: .version_select at 0x7f0395dd62f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1896067237", "metadata": {"Type": "work"}}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:56.291256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-86e70509-263c-4d7f-9a2b-d3bed330657d tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.182710 Apr 20 19:28:56.292821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 1/1] 10.222.0.38 () {60 vars in 1146 bytes} [Tue Apr 20 19:28:53 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3186 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 20 19:28:56.735749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e44f4ce1-ac91-4a6f-ba24-98a5e6117036 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Calling method '.version_select at 0x7f0395e92e18>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:57.090401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e44f4ce1-ac91-4a6f-ba24-98a5e6117036 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66" status: 200 len: 353 microversion: 2.1 time: 0.787132 Apr 20 19:28:57.091226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 1/2] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:28:56 2021] GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 => generated 353 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:28:58.105145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7f48c97c-42f2-48fc-918c-3c12610fa2cc tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Calling method '.version_select at 0x7f0395dd6b70>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:58.323234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7f48c97c-42f2-48fc-918c-3c12610fa2cc tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66" status: 200 len: 354 microversion: 2.1 time: 0.222957 Apr 20 19:28:58.324825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 2/3] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:28:58 2021] GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:28:58.338903 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a85f37c-6475-4127-815e-0437f4d17275 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Calling method '.version_select at 0x7f0395c9c400>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:58.522025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a85f37c-6475-4127-815e-0437f4d17275 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66" status: 200 len: 354 microversion: 2.1 time: 0.188998 Apr 20 19:28:58.523752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 2/4] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:28:58 2021] GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:28:58.536270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-91176c3b-60d7-46f4-90f6-ccc8160a3b8f tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Calling method '.version_select at 0x7f0395ca8d90>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:58.637780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1491080860", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "b7d70069-b804-4486-9edb-82c7d737dbd7"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:58.824262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-91176c3b-60d7-46f4-90f6-ccc8160a3b8f tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66" status: 202 len: 0 microversion: 2.1 time: 0.292145 Apr 20 19:28:58.825268 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 3/5] 10.222.0.38 () {58 vars in 1238 bytes} [Tue Apr 20 19:28:58 2021] DELETE /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:28:58.847796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-382512a1-5a0e-46a7-8e31-4ba3ddf9f4f4 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Calling method '.version_select at 0x7f0395ca8f28>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:28:58.919710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] validate_networks() for [('b7d70069-b804-4486-9edb-82c7d737dbd7', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:28:59.079615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-382512a1-5a0e-46a7-8e31-4ba3ddf9f4f4 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66" status: 200 len: 353 microversion: 2.1 time: 0.246863 Apr 20 19:28:59.080537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 4/6] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:28:58 2021] GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 => generated 353 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:28:59.347920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2030176489", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "94eaea9d-e39c-47da-9fde-443a214825c9"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:28:59.667012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] validate_networks() for [('94eaea9d-e39c-47da-9fde-443a214825c9', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:29:01.780876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:29:01.781359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:29:01.781907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:29:01.782369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:29:01.782830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:29:01.784382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:29:01.785068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:29:01.786025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:29:01.786650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:29:01.787292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:29:01.803439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:01.804831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:01.806077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:01.806753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:01.810384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:01.810852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:01.811734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:01.812221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:01.851873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:01.865882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for user 6b2a4b1c9ccc4943bc354e2702f6db24 and project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:01.871766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Getting quotas for project ac7d571d2ace4ec4813cdc944b1af495. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:01.880103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Getting quotas for user 57bbdd3bbdb34132b689790ee5e534e8 and project ac7d571d2ace4ec4813cdc944b1af495. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:01.887778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:29:01.902738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:29:01.914255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:29:01.917445 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:29:02.041823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6d15f885-b7f6-48d7-928b-a12aaf2ae8c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836644 Apr 20 19:29:02.043313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 5/7] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:28:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 2839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:29:02.054698 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f95236bc-8af9-4d77-9ca2-11723e0c71b5 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Calling method '.version_select at 0x7f0395bb4268>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:02.117420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3efbd4d-975c-43b6-871f-a25a1a510210 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.641179 Apr 20 19:29:02.120914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 3/8] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:28:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 3646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:29:02.127485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-624926a5-7ce1-4ea0-ba4a-8b91a7f6765d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:02.131338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-624926a5-7ce1-4ea0-ba4a-8b91a7f6765d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:02.220265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-f95236bc-8af9-4d77-9ca2-11723e0c71b5 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] HTTP exception thrown: Volume a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 could not be found. Apr 20 19:29:02.230179 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f95236bc-8af9-4d77-9ca2-11723e0c71b5 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] Returning 404 to user: Volume a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:29:02.231997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f95236bc-8af9-4d77-9ca2-11723e0c71b5 tempest-VolumesGetTestJSON-568592782 tempest-VolumesGetTestJSON-568592782-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66" status: 404 len: 109 microversion: 2.1 time: 0.187254 Apr 20 19:29:02.234886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 6/9] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:29:02 2021] GET /compute/v2.1/os-volumes/a44903a3-2c5a-42e5-8b7c-c3ff98c52b66 => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:29:02.243657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d473b1d3-91af-4538-a504-58a3a0ec49ba tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:02.246509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d473b1d3-91af-4538-a504-58a3a0ec49ba tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:02.403639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-624926a5-7ce1-4ea0-ba4a-8b91a7f6765d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:02.430590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-624926a5-7ce1-4ea0-ba4a-8b91a7f6765d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1218 microversion: 2.1 time: 0.307952 Apr 20 19:29:02.432271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 4/10] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:02 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1218 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:02.503812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d473b1d3-91af-4538-a504-58a3a0ec49ba tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:02.521186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d473b1d3-91af-4538-a504-58a3a0ec49ba tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1215 microversion: 2.1 time: 0.284966 Apr 20 19:29:02.521823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 7/11] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:02 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:03.449663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8906347b-bb8d-4503-925a-44bb2950f7bf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:03.450948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8906347b-bb8d-4503-925a-44bb2950f7bf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:03.540836 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-03dec5cf-27db-4ed7-a38d-d12d659c21d0 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:03.541502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-03dec5cf-27db-4ed7-a38d-d12d659c21d0 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:03.789289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8906347b-bb8d-4503-925a-44bb2950f7bf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:03.802741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8906347b-bb8d-4503-925a-44bb2950f7bf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1218 microversion: 2.1 time: 0.356864 Apr 20 19:29:03.803357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 5/12] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:03 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1218 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:03.868600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-03dec5cf-27db-4ed7-a38d-d12d659c21d0 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:03.896809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-03dec5cf-27db-4ed7-a38d-d12d659c21d0 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1215 microversion: 2.1 time: 0.347647 Apr 20 19:29:03.897806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 8/13] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:03 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:04.823297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:04.823944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:04.867664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:04.868424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:04.870996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:04.871725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:04.915912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:04.917027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:04.937979 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:04.938491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:04.939363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:04.940086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:05.281886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:05.301309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eaeef9a3-4aca-44e4-a823-43e1eca12c95 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1214 microversion: 2.1 time: 0.483515 Apr 20 19:29:05.302504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 6/14] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:04 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1214 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:05.358172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:05.381625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f1eb279a-95ba-4708-af5d-a65f7d29e935 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1267 microversion: 2.1 time: 0.470345 Apr 20 19:29:05.388807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 9/15] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:04 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1267 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:06.320433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:06.321161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:06.341958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:06.342476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:06.343358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:06.343837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:06.407529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:06.408532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:06.427374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:06.428199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:06.429902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:06.432923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:06.670962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:06.675719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:06.686605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-543759e8-b143-4190-84f5-49f80bd289ab tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1273 microversion: 2.1 time: 0.282966 Apr 20 19:29:06.687498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 10/16] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:06 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:06.687629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d39ca670-8581-4826-a460-3b424488bb45 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1270 microversion: 2.1 time: 0.369664 Apr 20 19:29:06.688676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 7/17] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:06 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1270 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:07.707261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:07.707745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:07.707960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:07.708105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:07.718139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:07.719059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:07.720369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:07.721073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:07.724398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:07.724924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:07.726330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:07.726938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:08.064546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:08.079002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0a901d39-d69e-4ed3-8e06-0fccd7200d58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1270 microversion: 2.1 time: 0.376167 Apr 20 19:29:08.079896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 11/18] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:07 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1270 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:08.202178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:08.228507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-854fc4e6-6759-43b1-956b-c6c85c35430c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1273 microversion: 2.1 time: 0.525057 Apr 20 19:29:08.231779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 8/19] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:07 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1273 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:09.104961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:09.105642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:09.123697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:09.124206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:09.125140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:09.125641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:09.249736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:09.250674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:09.268555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:09.269240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:09.270257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:09.276046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:09.815369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:09.827570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-01ff1a22-f00c-429f-99cc-4894d04fc64e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1288 microversion: 2.1 time: 0.728041 Apr 20 19:29:09.828397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 12/20] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:09 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1288 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:09.842721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-abf17ba7-fec9-4160-b3e4-be43154c0c37 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f0395bb4b70>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:09.888178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:09.906619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3567077b-bc65-4493-b209-e85a67e143a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1273 microversion: 2.1 time: 0.660947 Apr 20 19:29:09.907538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 9/21] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:09 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1273 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:10.155829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-abf17ba7-fec9-4160-b3e4-be43154c0c37 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/228d75bd-b1ce-4120-9a24-22b634890012" status: 200 len: 351 microversion: 2.1 time: 0.326413 Apr 20 19:29:10.157562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 13/22] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:29:09 2021] GET /compute/v2.1/os-volumes/228d75bd-b1ce-4120-9a24-22b634890012 => generated 351 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:10.796769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-40234c99-3286-4024-a54d-2b66e7f67f3b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'create', calling method: .version_select at 0x7f03962a3ea0>, body: {"keypair": {"name": "tempest-keypair-798277459"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:10.846737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:10.847671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:10.863962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:10.867167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:10.868232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:10.870966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:10.954740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-40234c99-3286-4024-a54d-2b66e7f67f3b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:10.984521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-40234c99-3286-4024-a54d-2b66e7f67f3b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for user 844312487ddb474093c475e63bb58c8c and project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:11.258654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:11.283628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7f7fd6f8-339a-4dcc-8f7a-a9a4f0fb9fad tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1276 microversion: 2.1 time: 0.441120 Apr 20 19:29:11.301841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 14/23] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:10 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1276 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:11.315807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:11.329656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:11.352090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:11.361437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:11.362959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:11.363670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:11.805943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:11.839400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-881e832c-7db6-40e7-a779-3f66eef6a49c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1273 microversion: 2.1 time: 0.536172 Apr 20 19:29:11.842707 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 15/24] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:11 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1273 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:12.181690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-40234c99-3286-4024-a54d-2b66e7f67f3b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:12.207987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-40234c99-3286-4024-a54d-2b66e7f67f3b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for user 844312487ddb474093c475e63bb58c8c and project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:12.251560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-40234c99-3286-4024-a54d-2b66e7f67f3b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.885913 Apr 20 19:29:12.252242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 10/25] 10.222.0.38 () {62 vars in 1189 bytes} [Tue Apr 20 19:29:10 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1887 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:29:12.320839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:12.322267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:12.343544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:12.344279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:12.345387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:12.346079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:12.359385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dacbcfbe-16a5-417f-8ca9-6ba4df18dc9d tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f0395305f28>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:12.540983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dacbcfbe-16a5-417f-8ca9-6ba4df18dc9d tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/aabe9a5d-cd3a-45d3-9d8a-3e958fbb5ca3" status: 200 len: 351 microversion: 2.1 time: 0.185652 Apr 20 19:29:12.553079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 11/26] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:29:12 2021] GET /compute/v2.1/os-volumes/aabe9a5d-cd3a-45d3-9d8a-3e958fbb5ca3 => generated 351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:12.724359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:12.741553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c3935c39-fcbd-4029-b292-e09896faa075 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1276 microversion: 2.1 time: 0.425706 Apr 20 19:29:12.749617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 16/27] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:12 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1276 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:12.858605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:12.859536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:12.888697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:12.890762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:12.893770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:12.894459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:13.767432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:13.768796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:13.816185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:13.820080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:13.822785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:13.825272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:14.006262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:14.021874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d29cbb9f-4abd-4a81-96a6-572e7da6e95b tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1273 microversion: 2.1 time: 1.168073 Apr 20 19:29:14.023136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 12/28] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:12 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1273 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:15.040533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:15.041240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:15.060254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:15.060784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:15.061651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:15.062142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:16.083522 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:16.099909 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-456138a3-544e-469a-ae7d-b9ac323097d9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 2.336736 Apr 20 19:29:16.114808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 17/29] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:13 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:16.165016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0fafc2ba-4194-4e37-bae0-4e50320e17f6 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f0395bb4730>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:16.422061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0fafc2ba-4194-4e37-bae0-4e50320e17f6 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/0adbfec1-6cde-40d8-969d-e9f19d2d4c15" status: 200 len: 351 microversion: 2.1 time: 0.261439 Apr 20 19:29:16.424108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 18/30] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:29:16 2021] GET /compute/v2.1/os-volumes/0adbfec1-6cde-40d8-969d-e9f19d2d4c15 => generated 351 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:16.437286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-932ede77-7069-466d-80f7-e4f234d5ddd3 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f03952c2ae8>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:16.743328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-932ede77-7069-466d-80f7-e4f234d5ddd3 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.310194 Apr 20 19:29:16.744461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 19/31] 10.222.0.38 () {58 vars in 1124 bytes} [Tue Apr 20 19:29:16 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:16.757621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-43acdf37-e997-47cd-9912-438d9e7a14e1 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f03952c2378>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:17.060938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-43acdf37-e997-47cd-9912-438d9e7a14e1 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.307702 Apr 20 19:29:17.061566 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 20/32] 10.222.0.38 () {58 vars in 1139 bytes} [Tue Apr 20 19:29:16 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:17.077815 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b33073ff-54a9-43b0-9e18-e6fee1b294b9 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f0395bb4b70>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:17.544602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b33073ff-54a9-43b0-9e18-e6fee1b294b9 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.473798 Apr 20 19:29:17.545825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 21/33] 10.222.0.38 () {58 vars in 1124 bytes} [Tue Apr 20 19:29:17 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:29:17.551163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:17.552037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:17.602928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:17.614100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:17.615351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:17.616231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:17.874620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:17.891815 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3bc93669-7c02-4363-a4b6-ab590cd0f88a tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 2.855309 Apr 20 19:29:17.900440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 13/34] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:15 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 2865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:17.926403 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02cabf50-2c45-448d-ab0d-5d0d37362c7c tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f0395305f28>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:18.341972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02cabf50-2c45-448d-ab0d-5d0d37362c7c tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.435275 Apr 20 19:29:18.343598 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 14/35] 10.222.0.38 () {58 vars in 1157 bytes} [Tue Apr 20 19:29:17 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:18.610923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:18.627002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e8834d4b-d8a2-4cc7-a99a-20a35478d5bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 1.079824 Apr 20 19:29:18.632046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 22/36] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:17 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:18.642804 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-56aa0d8c-a294-410f-bc99-d74346549fbe tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f03952f20d0>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:18.859900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-12e25356-2979-4cd8-817c-1464e3fda9a1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'create', calling method: .version_select at 0x7f039523d598>, body: {"keypair": {"name": "tempest-keypair-110473747"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:18.960678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-12e25356-2979-4cd8-817c-1464e3fda9a1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:18.977790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-12e25356-2979-4cd8-817c-1464e3fda9a1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for user 998b5783d8804bfa8d4a1c016b5666be and project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:18.996018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-56aa0d8c-a294-410f-bc99-d74346549fbe tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.362448 Apr 20 19:29:18.996887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 23/37] 10.222.0.38 () {58 vars in 1160 bytes} [Tue Apr 20 19:29:18 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:19.012538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:19.015478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:19.057937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:19.061901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:19.065373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:19.067394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:19.460362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-12e25356-2979-4cd8-817c-1464e3fda9a1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:19.478626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-12e25356-2979-4cd8-817c-1464e3fda9a1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for user 998b5783d8804bfa8d4a1c016b5666be and project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:19.528364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-12e25356-2979-4cd8-817c-1464e3fda9a1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.183342 Apr 20 19:29:19.532799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 15/38] 10.222.0.38 () {60 vars in 1148 bytes} [Tue Apr 20 19:29:18 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:19.545570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d6584f6b-89e1-4eae-8f84-f45f8c56853f tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f03962a3ea0>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:19.836146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d6584f6b-89e1-4eae-8f84-f45f8c56853f tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.299356 Apr 20 19:29:19.837203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 16/39] 10.222.0.38 () {58 vars in 1145 bytes} [Tue Apr 20 19:29:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:19.842382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:19.846668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:19.897078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:19.908426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:19.909724 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:19.914081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:20.260663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:20.288579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d98d92d-ed7b-4813-b61c-6f839b5b11fa tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 1.273238 Apr 20 19:29:20.308948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 24/40] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:19 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:20.314444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7151d133-42d6-4962-aa7c-c974bd7e93a5 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f03952f2c80>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:20.599672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7151d133-42d6-4962-aa7c-c974bd7e93a5 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.288931 Apr 20 19:29:20.601579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 25/41] 10.222.0.38 () {58 vars in 1178 bytes} [Tue Apr 20 19:29:20 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:20.617346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-62271494-2918-435f-afb1-089352122761 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] Calling method '.version_select at 0x7f03952c2f28>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:20.845710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-62271494-2918-435f-afb1-089352122761 tempest-VolumesTestJSON-817774901 tempest-VolumesTestJSON-817774901-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.232761 Apr 20 19:29:20.846679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 26/42] 10.222.0.38 () {58 vars in 1145 bytes} [Tue Apr 20 19:29:20 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:21.019067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:21.032033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2449538b-90fb-4a6a-813b-7b67e083c212 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 1.193476 Apr 20 19:29:21.032752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 17/43] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:19 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:21.316244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:21.317015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:21.339265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:21.340817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:21.345608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:21.346292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:22.052040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:22.052699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:22.077704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:22.084952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:22.086277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:22.087078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:23.511439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:23.527662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c151f3d9-d1b5-4527-ab7e-991d63bb06b9 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 2.215842 Apr 20 19:29:23.531989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 27/44] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:21 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:23.744274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:23.754846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-87f89e45-1d3e-4473-8b80-60551bb0a1c6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 1.707015 Apr 20 19:29:23.766169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 18/45] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:22 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:23.967296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-967370957", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83a9f6c9-14bf-4451-bd3a-5335ab5e684a"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:24.241342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] validate_networks() for [('83a9f6c9-14bf-4451-bd3a-5335ab5e684a', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:29:24.256441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1157823204", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82da78ec-751b-430a-a7da-562971e5fcc7"}], "security_groups": [{"name": "tempest-securitygroup--451566317"}], "key_name": "tempest-keypair-798277459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:24.634092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] validate_networks() for [('82da78ec-751b-430a-a7da-562971e5fcc7', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:29:26.030880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:29:26.031332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:29:26.031883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:29:26.032346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:29:26.032837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:29:26.046271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:26.046999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:26.048070 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:26.048877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:26.087306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Getting quotas for project 8a872b344d5e4785bc501bb382a739e4. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:26.091893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Getting quotas for user a5f84dbc0f2b457bb525c44c7564f9f4 and project 8a872b344d5e4785bc501bb382a739e4. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:26.111223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:29:26.114770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:29:26.190941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bc9b4c73-e9dd-4403-962c-ca5e8b58adfa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.651348 Apr 20 19:29:26.191875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 28/46] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:29:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 2653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:29:26.200074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:26.201160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:26.211640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:26.212344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:26.213385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:26.214024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.101652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:27.135048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c87d5e7a-ea2b-47ab-86b6-53a1801a4a60 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 0.941219 Apr 20 19:29:27.135711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 29/47] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:26 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:27.174414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:29:27.174867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:29:27.175472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:29:27.175934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:29:27.176397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:29:27.183122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:27.184351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:27.208492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.211790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.216315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.217064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.219177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.221475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.222635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.223174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.300679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:27.307735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for user 844312487ddb474093c475e63bb58c8c and project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:27.322390 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:29:27.328031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:29:27.548146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d5f73624-5a2d-469c-9f48-1a241ed1c467 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.296453 Apr 20 19:29:27.552819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 19/48] 10.222.0.38 () {62 vars in 1178 bytes} [Tue Apr 20 19:29:24 2021] POST /compute/v2.1/servers => generated 401 bytes in 3302 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 19:29:27.687841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-bd25507b-18bd-43a5-a583-45b8a4706eca req-23b68e70-b75f-4938-9124-8435c2877b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58c9af7-b045-4297-8a28-31e6301db247", "tag": "f0995049-fd0b-42d5-9ca2-b48ccf5db473"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:27.690214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:27.690214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:27.715369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bd25507b-18bd-43a5-a583-45b8a4706eca req-23b68e70-b75f-4938-9124-8435c2877b6e service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.716342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bd25507b-18bd-43a5-a583-45b8a4706eca req-23b68e70-b75f-4938-9124-8435c2877b6e service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.741578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:27.752896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2da01d51-ae2d-4e06-a2a6-aa8348152761 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 0.615807 Apr 20 19:29:27.754560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 30/49] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:27 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:27.761530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-bd25507b-18bd-43a5-a583-45b8a4706eca req-23b68e70-b75f-4938-9124-8435c2877b6e service nova] Creating event network-changed:f0995049-fd0b-42d5-9ca2-b48ccf5db473 for instance f58c9af7-b045-4297-8a28-31e6301db247 on hv-cinder-78726 Apr 20 19:29:27.766236 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-bd25507b-18bd-43a5-a583-45b8a4706eca req-23b68e70-b75f-4938-9124-8435c2877b6e service nova] Acquired lock "compute-rpcapi-router" {{(pid=100563) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 19:29:27.767435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:27.767955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3af12f10-6460-46a6-8a69-4d998c827b91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.768617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3af12f10-6460-46a6-8a69-4d998c827b91 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.769668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3af12f10-6460-46a6-8a69-4d998c827b91 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.772397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3af12f10-6460-46a6-8a69-4d998c827b91 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.781886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:27.783682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.compute.rpcapi [None req-3af12f10-6460-46a6-8a69-4d998c827b91 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 19:29:27.784732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3af12f10-6460-46a6-8a69-4d998c827b91 None None] Releasing lock "compute-rpcapi-router" {{(pid=100563) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 19:29:27.822665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.827697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.829217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:27.829833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:27.844402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3af12f10-6460-46a6-8a69-4d998c827b91 None None] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286733 Apr 20 19:29:27.845148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 20/50] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:27.854079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f245d029-236f-44e4-864c-32f3d4577c0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:27.855826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f245d029-236f-44e4-864c-32f3d4577c0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:28.102734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f245d029-236f-44e4-864c-32f3d4577c0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:28.116429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f245d029-236f-44e4-864c-32f3d4577c0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:28.120723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f245d029-236f-44e4-864c-32f3d4577c0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:28.124828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f245d029-236f-44e4-864c-32f3d4577c0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1281 microversion: 2.20 time: 0.278211 Apr 20 19:29:28.128280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 21/51] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:27 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:28.163399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:28.164312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:28.186947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:28.187456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:28.188301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:28.190250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:28.191378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:28.205469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-095f6aaa-a902-4d80-ba1e-174d5c9308b5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1273 microversion: 2.1 time: 0.448589 Apr 20 19:29:28.206268 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 31/52] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:27 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:28.399717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1860271633", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83a9f6c9-14bf-4451-bd3a-5335ab5e684a"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:28.522737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] validate_networks() for [('83a9f6c9-14bf-4451-bd3a-5335ab5e684a', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:29:29.286151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:29.296202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4a55dfc9-1201-4842-bcae-b267672ffebb tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 1.137940 Apr 20 19:29:29.296913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 22/53] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:28 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:29:29.302342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:29.303289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:29.313085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.313770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.315880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.316750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.723161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:29.732480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e6bd592-39c1-4d63-845e-b0f73154139d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 0.434230 Apr 20 19:29:29.733443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 23/54] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:29 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:29.738319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:29.739211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:29.747490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.748308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.749326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.749831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.772932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:29:29.773417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:29:29.773971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:29:29.774436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:29:29.774905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:29:29.800016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.802700 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.804305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.809350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.843766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Getting quotas for project 8a872b344d5e4785bc501bb382a739e4. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:29.856520 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Getting quotas for user a5f84dbc0f2b457bb525c44c7564f9f4 and project 8a872b344d5e4785bc501bb382a739e4. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:29.872840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:29:29.878349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:29:29.878925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:29.890916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:29.892649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:29.894118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f5462d7c-a733-45fa-8d0e-b477bb00ff0a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1285 microversion: 2.20 time: 0.159801 Apr 20 19:29:29.894899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 24/55] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:29 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:29.900902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-755514296", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4427720-1bf7-4b3c-8e43-4a0696109808"}], "security_groups": [{"name": "tempest-securitygroup--928007192"}], "key_name": "tempest-keypair-110473747", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:29.942800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d7293ec4-5c9b-45b4-b817-647f9937d751 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.548071 Apr 20 19:29:29.944025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 32/56] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:29:28 2021] POST /compute/v2.1/servers => generated 383 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:29:29.950442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d3b82197-0422-4a70-bf6e-d25294edb134 req-b8631b1e-e40f-4ecb-a3cc-e357192cc104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09", "tag": "cdd9c1d0-c0d8-48c5-adc9-0e30b378e2ca"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:29.953494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:29.953494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:29.964136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d3b82197-0422-4a70-bf6e-d25294edb134 req-b8631b1e-e40f-4ecb-a3cc-e357192cc104 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.965309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d3b82197-0422-4a70-bf6e-d25294edb134 req-b8631b1e-e40f-4ecb-a3cc-e357192cc104 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.990235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-d3b82197-0422-4a70-bf6e-d25294edb134 req-b8631b1e-e40f-4ecb-a3cc-e357192cc104 service nova] Creating event network-changed:cdd9c1d0-c0d8-48c5-adc9-0e30b378e2ca for instance a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 on hv-cinder-78726 Apr 20 19:29:29.991621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d3b82197-0422-4a70-bf6e-d25294edb134 req-b8631b1e-e40f-4ecb-a3cc-e357192cc104 service nova] Acquired lock "compute-rpcapi-router" {{(pid=100562) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 19:29:29.993080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba41aeca-7e9f-4821-9d71-4ea279ad6702 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.994163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba41aeca-7e9f-4821-9d71-4ea279ad6702 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:29.995201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba41aeca-7e9f-4821-9d71-4ea279ad6702 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:29.996008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba41aeca-7e9f-4821-9d71-4ea279ad6702 None None] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:30.008855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.compute.rpcapi [None req-ba41aeca-7e9f-4821-9d71-4ea279ad6702 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 19:29:30.010710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba41aeca-7e9f-4821-9d71-4ea279ad6702 None None] Releasing lock "compute-rpcapi-router" {{(pid=100562) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 19:29:30.041231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ba41aeca-7e9f-4821-9d71-4ea279ad6702 None None] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095414 Apr 20 19:29:30.042131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 33/57] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:30.048786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d398c958-cd96-4ca2-a614-429e9ff1f9aa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:30.050048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d398c958-cd96-4ca2-a614-429e9ff1f9aa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:30.208077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d398c958-cd96-4ca2-a614-429e9ff1f9aa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:30.220416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d398c958-cd96-4ca2-a614-429e9ff1f9aa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1222 microversion: 2.1 time: 0.174746 Apr 20 19:29:30.221359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 34/58] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:30 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:30.244086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] validate_networks() for [('f4427720-1bf7-4b3c-8e43-4a0696109808', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:29:30.315970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:30.316993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:30.326723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:30.327307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:30.328374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:30.329216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:30.662316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:30.672168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cf515850-946c-485d-a382-63f35b18687c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 0.360292 Apr 20 19:29:30.673018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 35/59] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:30 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:30.752071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:30.752897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:30.761608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:30.762236 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:30.763323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:30.763930 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.114854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:29:31.116193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:29:31.117423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:29:31.117907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:29:31.118401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:29:31.130238 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.130753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.132646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.133344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.152136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:31.162837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-434aa5eb-097f-4dc6-b130-7bb729c0bd08 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 0.414692 Apr 20 19:29:31.163641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 36/60] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:30 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:31.181294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:29:31.186260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for user 998b5783d8804bfa8d4a1c016b5666be and project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:29:31.193337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:31.194081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:31.199954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:29:31.203395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:29:31.223805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.227989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.229159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.229797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.334576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4eb3fc9e-bdcd-4a23-bf48-2d920c3792ef tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.438303 Apr 20 19:29:31.335878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 25/61] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:29:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:29:31.348859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:31.364768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:31.384303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.384846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.390073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.390625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.847999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:31.849748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:31.860420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3125886e-b7be-47f0-a438-702b43245a2c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1226 microversion: 2.1 time: 0.523165 Apr 20 19:29:31.861552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 26/62] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:31 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1226 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:31.871562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:31.871562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:31.871562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e59c82ed-b104-4f83-9b04-29219df81fa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1277 microversion: 2.20 time: 0.703182 Apr 20 19:29:31.871877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 37/63] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:31 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1277 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:31.876771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a54179be-c905-4187-bfab-8e49531513b9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:31.877663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a54179be-c905-4187-bfab-8e49531513b9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:31.899342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:31.900032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:31.916221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.921735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:31.922799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:31.924744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:32.013656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a54179be-c905-4187-bfab-8e49531513b9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:32.027211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a54179be-c905-4187-bfab-8e49531513b9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1236 microversion: 2.1 time: 0.157420 Apr 20 19:29:32.028941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 38/64] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:31 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1236 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:32.182183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:32.183055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:32.215429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:32.227828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:32.229294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:32.230014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:33.662922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:33.685781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79365f4d-c1a9-4298-9d3e-f3f41c75dd8d tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 1.800809 Apr 20 19:29:33.686478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 27/65] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:31 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:33.691533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:33.697469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:33.712012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:33.715062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:33.716110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:33.717106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:34.037839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:34.045669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-82c1972b-92b3-49f8-90bf-6c1f652160a3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 1.868180 Apr 20 19:29:34.046768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 39/66] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:32 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:29:34.062758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:34.063658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:34.072590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:34.073739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:34.074961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:34.075657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:34.243330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:34.265178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6c7ba6b5-28bd-409c-8721-3cbb662f9763 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1292 microversion: 2.1 time: 0.577294 Apr 20 19:29:34.265841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 28/67] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:33 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1292 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:34.276669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:34.277438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:34.302793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:34.305025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:34.305881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:34.306382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:34.363492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:34.378579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:34.384353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:34.385773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3359d84a-1182-4f17-8c09-29fcac853607 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1339 microversion: 2.20 time: 0.327242 Apr 20 19:29:34.399049 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 40/68] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:34 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1339 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:34.577203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:34.593030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-283ccec6-c09f-4789-a0c2-8d76c567ff50 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1306 microversion: 2.1 time: 0.326011 Apr 20 19:29:34.594123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 29/69] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:34 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:34.706849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:34.707494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:34.719487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:34.720218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:34.721327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:34.722077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:35.064289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:35.065288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:35.078653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:35.079592 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:35.086117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:35.086841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:35.111594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:35.125623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-25cfa31f-4826-4639-83fe-a8e6631f58a6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 0.425447 Apr 20 19:29:35.126284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 41/70] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:34 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:35.285449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:35.286379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:35.306577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:35.307410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:35.308339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:35.308878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:35.633392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:35.650105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-583144a4-ebcb-4141-96ac-26f92100109f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1280 microversion: 2.1 time: 0.369189 Apr 20 19:29:35.650986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 42/71] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:35 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1280 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:35.656026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:35.657286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:35.681501 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:35.682673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:35.683864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:35.684488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.226687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:36.238952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3497574d-4956-4e55-92a3-574a0411a250 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 1.178464 Apr 20 19:29:36.239759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 30/72] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:35 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:29:36.247202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:36.248258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:36.259108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:36.259626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.260499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:36.261072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.304237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:36.316456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:36.319674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:36.321274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-57572b83-45c9-4723-ac48-ba9678ee9d16 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.668966 Apr 20 19:29:36.321906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 43/73] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:35 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:36.468992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:36.478869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6e400bc8-e638-4446-abe3-19f6de01c755 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1294 microversion: 2.1 time: 0.236935 Apr 20 19:29:36.479630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 31/74] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:36 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1294 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:36.484297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:36.485038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:36.493518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:36.494082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.494952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:36.495452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.496572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-34336211-ffd9-42e1-ad19-ba3918cf3a0f req-e0b42b7f-420e-4026-ab11-aa959dc8e7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09", "name": "network-vif-plugged", "status": "completed", "tag": "cdd9c1d0-c0d8-48c5-adc9-0e30b378e2ca"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:36.499371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:36.499371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:36.509122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-34336211-ffd9-42e1-ad19-ba3918cf3a0f req-e0b42b7f-420e-4026-ab11-aa959dc8e7e5 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:36.510021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-34336211-ffd9-42e1-ad19-ba3918cf3a0f req-e0b42b7f-420e-4026-ab11-aa959dc8e7e5 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.529340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-34336211-ffd9-42e1-ad19-ba3918cf3a0f req-e0b42b7f-420e-4026-ab11-aa959dc8e7e5 service nova] Creating event network-vif-plugged:cdd9c1d0-c0d8-48c5-adc9-0e30b378e2ca for instance a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 on hv-cinder-78726 Apr 20 19:29:36.535732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-34336211-ffd9-42e1-ad19-ba3918cf3a0f req-e0b42b7f-420e-4026-ab11-aa959dc8e7e5 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211935 Apr 20 19:29:36.536641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 44/75] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:36.669248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:36.670021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:36.678455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:36.678965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.679808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:36.680298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:36.740145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:36.759211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e3c9cf9-2be0-4616-ab66-575f00c73de7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 0.278643 Apr 20 19:29:36.762496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 32/76] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:36 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:36.930234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:36.939239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-54b30e72-ced5-4139-82c7-7c743ed4c26a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.275064 Apr 20 19:29:36.939852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 45/77] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:36 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:37.258432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:37.259740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:37.267757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.268273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.269164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.269661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.322052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-23bb4f71-0bb6-4350-a878-41aeed7349ad req-4b0a3482-1351-41dd-a2f3-fbeb01891cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9c99e67-a6e2-4f90-bb81-d4e3f368f1de", "tag": "7dd320e4-5118-4b15-8942-5329b2b163c1"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:37.323912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:37.323912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:37.332826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-23bb4f71-0bb6-4350-a878-41aeed7349ad req-4b0a3482-1351-41dd-a2f3-fbeb01891cd9 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.333334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-23bb4f71-0bb6-4350-a878-41aeed7349ad req-4b0a3482-1351-41dd-a2f3-fbeb01891cd9 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.353503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-23bb4f71-0bb6-4350-a878-41aeed7349ad req-4b0a3482-1351-41dd-a2f3-fbeb01891cd9 service nova] Creating event network-changed:7dd320e4-5118-4b15-8942-5329b2b163c1 for instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de on hv-cinder-78726 Apr 20 19:29:37.358474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-23bb4f71-0bb6-4350-a878-41aeed7349ad req-4b0a3482-1351-41dd-a2f3-fbeb01891cd9 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040709 Apr 20 19:29:37.359306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 46/78] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:37.364594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:37.365436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:37.373521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.374035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.374884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.375384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.546057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:37.554968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fbec48ed-8756-4539-accf-7ff8e7d7f248 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 0.300990 Apr 20 19:29:37.555607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 33/79] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:37 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:37.560695 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:37.560931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:37.570017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.570528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.571384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.571882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.628919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:37.638516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:37.640175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:37.641366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7eb0cc2a-4ef9-4b9e-8d8e-58b90fbd57c9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.280984 Apr 20 19:29:37.641979 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 47/80] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:37 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:37.777877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:37.778554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:37.786691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.787230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.789211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.789682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.793006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:37.802820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e088a00b-9e95-4a76-aa4a-1065972312be tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.246140 Apr 20 19:29:37.803480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 34/81] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:37 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:37.957549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:37.958257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:37.966686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.967201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:37.968059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:37.968561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:38.009941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:38.018807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-81c33608-864e-4aee-b24e-82c6cd40a034 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 0.245018 Apr 20 19:29:38.019451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 48/82] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:37 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:38.183170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:38.192093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc29ecdb-b9c5-4f9b-bd3d-cfb5977c5eed tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.238704 Apr 20 19:29:38.192740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 35/83] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:37 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:29:38.551365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6b00e97d-2cec-43aa-9372-097da0502530 req-46abe600-eee4-4bf4-b233-2a4575218aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58c9af7-b045-4297-8a28-31e6301db247", "name": "network-vif-plugged", "status": "completed", "tag": "f0995049-fd0b-42d5-9ca2-b48ccf5db473"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:38.553692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:38.553692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:38.562803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6b00e97d-2cec-43aa-9372-097da0502530 req-46abe600-eee4-4bf4-b233-2a4575218aa6 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:38.563247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6b00e97d-2cec-43aa-9372-097da0502530 req-46abe600-eee4-4bf4-b233-2a4575218aa6 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:38.573400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:38.574952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:38.582026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6b00e97d-2cec-43aa-9372-097da0502530 req-46abe600-eee4-4bf4-b233-2a4575218aa6 service nova] Creating event network-vif-plugged:f0995049-fd0b-42d5-9ca2-b48ccf5db473 for instance f58c9af7-b045-4297-8a28-31e6301db247 on hv-cinder-78726 Apr 20 19:29:38.582162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:38.582572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:38.583551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:38.584056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:38.588052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6b00e97d-2cec-43aa-9372-097da0502530 req-46abe600-eee4-4bf4-b233-2a4575218aa6 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040669 Apr 20 19:29:38.588777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 49/84] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:38.660779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:38.662219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:38.670428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:38.670932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:38.671782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:38.672279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:39.334791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:39.349782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb6ec780-a136-4869-a6f8-dbaf64f8fd87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 0.781101 Apr 20 19:29:39.362680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 36/85] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:38 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:29:39.369689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:39.371164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:39.382895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:39.383665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:39.385136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:39.385767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:39.499064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:39.513988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:39.515643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:39.516852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc555ab0-49fe-4c5f-8dc2-e35b4162c955 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.860996 Apr 20 19:29:39.518952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 50/86] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:38 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:29:39.524482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:39.525307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:39.534575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:39.549263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:39.550260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:39.550742 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:40.287726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:40.308646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3d0fb9b5-1c1e-4a34-b3e0-7d2e4ad28226 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.943386 Apr 20 19:29:40.310936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 37/87] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:39 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:40.316991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:40.317899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:40.330763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:40.331428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:40.332430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:40.332975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:40.368104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:40.377375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ddc9412-05dc-4e65-9cab-5ad19213be8f tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 0.857141 Apr 20 19:29:40.378434 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 51/88] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:39 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:40.384319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:40.385216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:40.393705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:40.394470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:40.395504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:40.396180 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:41.132032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:41.148126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c7fe9277-bacc-4983-8901-715a2cfd31ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.835319 Apr 20 19:29:41.149124 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 38/89] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:40 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:41.155189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:41.156236 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:41.164927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:41.167521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:41.168358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:41.170356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:41.171168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:41.185467 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6153cb7-3fc4-41d7-8c4a-5e8ee0784326 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1318 microversion: 2.1 time: 0.805681 Apr 20 19:29:41.186092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 52/90] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:40 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1318 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:41.327615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:41.328291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:41.340206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:41.340757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:41.341613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:41.342114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.202989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:42.217603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:42.224118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:42.227160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d98e157c-063e-405f-abe6-70c9548658a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 1.076701 Apr 20 19:29:42.227918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 39/91] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:41 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:42.243910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:42.244590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:42.248934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:42.259802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.260294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.261486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.262129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.263810 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88e960e0-1390-4568-a654-1160a74d5b7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.940138 Apr 20 19:29:42.265194 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 53/92] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:41 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:42.390038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c32e0383-6a79-4ccc-ac9e-c4853e4829d0 req-e1a95b91-cb68-4eca-986a-604aa7ca035b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ca897f-86b0-4162-a72d-2a399eef0f34", "tag": "22a8b0f9-0716-4893-9db4-55b6fdf5988e"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:42.402211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:42.402211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:42.444493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c32e0383-6a79-4ccc-ac9e-c4853e4829d0 req-e1a95b91-cb68-4eca-986a-604aa7ca035b service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.454019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c32e0383-6a79-4ccc-ac9e-c4853e4829d0 req-e1a95b91-cb68-4eca-986a-604aa7ca035b service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.506495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c32e0383-6a79-4ccc-ac9e-c4853e4829d0 req-e1a95b91-cb68-4eca-986a-604aa7ca035b service nova] Creating event network-changed:22a8b0f9-0716-4893-9db4-55b6fdf5988e for instance 75ca897f-86b0-4162-a72d-2a399eef0f34 on hv-cinder-78726 Apr 20 19:29:42.524326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c32e0383-6a79-4ccc-ac9e-c4853e4829d0 req-e1a95b91-cb68-4eca-986a-604aa7ca035b service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257501 Apr 20 19:29:42.529734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 54/93] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:42.548911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a91a2103-ece5-4f0c-b87d-3978d3ab02dc req-b38e9531-2571-42f3-a471-3a9165dad034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ed4913-e7ef-455c-9061-477f1274e3b7", "tag": "8e197005-0c8e-41e1-ac1e-defb1c9d189c"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:42.551655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:42.551655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:42.567579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a91a2103-ece5-4f0c-b87d-3978d3ab02dc req-b38e9531-2571-42f3-a471-3a9165dad034 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.568634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a91a2103-ece5-4f0c-b87d-3978d3ab02dc req-b38e9531-2571-42f3-a471-3a9165dad034 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.599118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a91a2103-ece5-4f0c-b87d-3978d3ab02dc req-b38e9531-2571-42f3-a471-3a9165dad034 service nova] Creating event network-changed:8e197005-0c8e-41e1-ac1e-defb1c9d189c for instance d9ed4913-e7ef-455c-9061-477f1274e3b7 on hv-cinder-78726 Apr 20 19:29:42.605012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a91a2103-ece5-4f0c-b87d-3978d3ab02dc req-b38e9531-2571-42f3-a471-3a9165dad034 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070666 Apr 20 19:29:42.606461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 55/94] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:42.614684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:42.615407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:42.625271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.625967 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.627185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.627871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.887039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:42.896509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83a5b4d5-132c-4578-bc9a-27c8a27ca967 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1315 microversion: 2.1 time: 0.665745 Apr 20 19:29:42.897694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 40/95] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:42 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:42.912131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:42.912890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:42.921775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.922294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:42.923131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:42.923815 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:43.265846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:43.278708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02e8de88-595c-479d-b121-c203ea905d54 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.670699 Apr 20 19:29:43.281142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 56/96] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:42 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:43.297739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:43.305805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:43.322384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:43.323244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:43.324746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:43.325765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:43.771262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:43.784278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f643e639-b3ad-4b36-906d-ac0661adbb86 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1508 microversion: 2.1 time: 0.885279 Apr 20 19:29:43.786107 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 41/97] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:42 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1508 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:43.795807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:43.796685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:43.825146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:43.825879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:43.827500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:43.828317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:44.144642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:44.165098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:44.168668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:44.170792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5741bae-1069-433b-bf1e-6b63bb52a69c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.887923 Apr 20 19:29:44.171936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 57/98] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:43 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:44.180086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:44.181327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:44.192105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:44.192801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:44.195389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:44.196072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:44.520272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:44.538370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-58455d34-2e46-4a90-8c99-ea4a9e1edbc6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.748472 Apr 20 19:29:44.539921 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 42/99] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:43 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:44.555108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:44.556089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:44.578423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:44.579321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:44.580498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:44.581372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:44.960338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:44.971352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b37db4d4-147c-42c0-a6b6-8a2e8711aef2 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1502 microversion: 2.1 time: 0.797456 Apr 20 19:29:44.978748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 58/100] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:44 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1502 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:44.984325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6d5dbb9a-9057-476d-8add-9193f2f65f71 req-018b8fb5-0ae6-4f37-b05e-e42537e9e6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c66822-12bf-4406-b7d7-8da089316106", "tag": "8b80eb18-b82a-4b8e-a9d4-1f24cd0c8a5a"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:44.991516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:44.991516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:45.012960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6d5dbb9a-9057-476d-8add-9193f2f65f71 req-018b8fb5-0ae6-4f37-b05e-e42537e9e6bc service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:45.017740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6d5dbb9a-9057-476d-8add-9193f2f65f71 req-018b8fb5-0ae6-4f37-b05e-e42537e9e6bc service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:45.052045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6d5dbb9a-9057-476d-8add-9193f2f65f71 req-018b8fb5-0ae6-4f37-b05e-e42537e9e6bc service nova] Creating event network-changed:8b80eb18-b82a-4b8e-a9d4-1f24cd0c8a5a for instance b5c66822-12bf-4406-b7d7-8da089316106 on hv-cinder-78726 Apr 20 19:29:45.060256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6d5dbb9a-9057-476d-8add-9193f2f65f71 req-018b8fb5-0ae6-4f37-b05e-e42537e9e6bc service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079567 Apr 20 19:29:45.061354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 59/101] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:45.191679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:45.192759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:45.211402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:45.212201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:45.213372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:45.214034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:45.380131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:45.393859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-47ead36b-4d1e-47fe-8360-405310a873f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.849247 Apr 20 19:29:45.407587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 43/102] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:44 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:45.562901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:45.563895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:45.581618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:45.582133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:45.583009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:45.583501 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:46.258039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:46.276461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:46.283402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:46.286033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c6308ce1-1ff5-4282-a4b6-06cadaf6d976 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 1.098347 Apr 20 19:29:46.287007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 60/103] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:45 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:29:46.304454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0b2691d0-c73a-4c49-9e55-92278c0a09c9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7fb7095-f241-4f36-9ccb-2c7f80c01a29"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:46.307695 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0b2691d0-c73a-4c49-9e55-92278c0a09c9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:46.340222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b2691d0-c73a-4c49-9e55-92278c0a09c9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:46.344326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b2691d0-c73a-4c49-9e55-92278c0a09c9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:46.348230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b2691d0-c73a-4c49-9e55-92278c0a09c9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:46.349055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b2691d0-c73a-4c49-9e55-92278c0a09c9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:46.355212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:46.366879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5b1fcca-84ed-4b3a-936a-08cf535f1a4c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.808742 Apr 20 19:29:46.368453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 44/104] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:45 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:46.416562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:46.417582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:46.426464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:46.427340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:46.429683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:46.430429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:46.761276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:46.775253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f7097baf-5484-4500-be37-7e9b1d1e5305 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.364161 Apr 20 19:29:46.776030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 45/105] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:46 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:46.948049 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c4c70228-0619-45d4-9541-4a24b6207565 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5f61c34-996e-407e-9c4d-ac7850e27561"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:46.949722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c4c70228-0619-45d4-9541-4a24b6207565 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:46.974984 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4c70228-0619-45d4-9541-4a24b6207565 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:46.975933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4c70228-0619-45d4-9541-4a24b6207565 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:46.976510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4c70228-0619-45d4-9541-4a24b6207565 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:46.977046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4c70228-0619-45d4-9541-4a24b6207565 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:47.503048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0b2691d0-c73a-4c49-9e55-92278c0a09c9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212077 Apr 20 19:29:47.505853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 61/106] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:29:46 2021] POST /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09/os-volume_attachments => generated 194 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:47.539459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:47.542557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:47.558685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:47.563379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:47.564528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:47.565173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:47.818641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c4c70228-0619-45d4-9541-4a24b6207565 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "POST /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875480 Apr 20 19:29:47.819326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 46/107] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:29:46 2021] POST /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:47.840982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:47.841767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:47.870252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:47.871095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:47.872642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:47.873409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:47.975751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:47.989527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:47.991328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:47.992538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c892bfc5-ba3e-434b-b043-b75638f66c78 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.483861 Apr 20 19:29:48.003740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 62/108] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:47 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:48.003740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:48.003740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:48.023145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:48.024208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:48.025149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:48.028466 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:48.503818 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:48.514491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3985b22b-5d10-4a28-b816-896552bf6d68 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.693903 Apr 20 19:29:48.517721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 47/109] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:47 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:48.544993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:48.555532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-530feb34-70a8-4bbb-b9f2-08775bac7b2b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.557024 Apr 20 19:29:48.556171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 63/110] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:47 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:49.012051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:49.012751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:49.020537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:49.021060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:49.022692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:49.023182 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:49.356754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:49.372175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:49.375396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:49.378292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a8668ba9-6d32-4b90-aa8d-904a4521d274 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.369413 Apr 20 19:29:49.380427 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 48/111] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:49 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:49.535862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:49.536546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:49.546834 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:49.547353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:49.548480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:49.548701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:49.574304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:49.575287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:49.590803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:49.592798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:49.595295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:49.597646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:50.075824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:50.088764 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2b64ac62-f63f-4c68-beeb-406999a97c53 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.557036 Apr 20 19:29:50.100800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 64/112] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:49 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:50.131299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:50.141060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-41b14f73-b0a2-41fa-88c7-368cf1a2dbc3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.571628 Apr 20 19:29:50.143186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 49/113] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:49 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:50.407232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:50.409392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:50.432591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:50.433158 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:50.434017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:50.434508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:50.830986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:50.847177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:50.849032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:50.850922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2abe040e-8e08-467b-a8ca-020d47c6fbe9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.455055 Apr 20 19:29:50.851547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 65/114] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:50 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:51.106883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:51.107538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:51.116235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:51.116760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:51.117608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:51.118139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:51.164738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:51.166518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:51.181514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:51.182285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:51.183919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:51.184629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:51.495076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:51.506671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-05eb3d8a-eb27-4505-82ba-a352d5563314 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.403073 Apr 20 19:29:51.508138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 50/115] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:51 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:51.578460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:51.588397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f62d6851-b78a-4d38-94a3-56d624449aa6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.431447 Apr 20 19:29:51.589580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 66/116] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:51 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:51.872794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:51.874011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:51.894475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:51.895269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:51.897180 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:51.906913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:52.190426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:52.200862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:52.203014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:52.204304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-501e2347-bca0-43b4-9cfb-01fd447b2633 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.336785 Apr 20 19:29:52.205177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 51/117] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:51 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:52.527081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:52.528058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:52.538669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:52.539959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:52.541176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:52.542904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:52.609581 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:52.610946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:52.620489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:52.621075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:52.622145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:52.622902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:52.889374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:52.902050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-946c289e-8779-4d8b-9bd5-4f87f3e9e92a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.380986 Apr 20 19:29:52.902683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 67/118] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:52 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:52.925427 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c5993b03-7622-4631-a0dd-af582ae4b28e req-dad638fe-e1c2-46bf-a38f-2936925022c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca897f-86b0-4162-a72d-2a399eef0f34", "name": "network-vif-plugged", "status": "completed", "tag": "22a8b0f9-0716-4893-9db4-55b6fdf5988e"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:52.928489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:52.928489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:52.938671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c5993b03-7622-4631-a0dd-af582ae4b28e req-dad638fe-e1c2-46bf-a38f-2936925022c8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:52.939331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c5993b03-7622-4631-a0dd-af582ae4b28e req-dad638fe-e1c2-46bf-a38f-2936925022c8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:52.967785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c5993b03-7622-4631-a0dd-af582ae4b28e req-dad638fe-e1c2-46bf-a38f-2936925022c8 service nova] Creating event network-vif-plugged:22a8b0f9-0716-4893-9db4-55b6fdf5988e for instance 75ca897f-86b0-4162-a72d-2a399eef0f34 on hv-cinder-78726 Apr 20 19:29:52.982420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c5993b03-7622-4631-a0dd-af582ae4b28e req-dad638fe-e1c2-46bf-a38f-2936925022c8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061375 Apr 20 19:29:52.983118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 68/119] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:29:53.047508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:53.063127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c54124a4-eb61-4d1e-9c6c-6723657d5d74 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.457676 Apr 20 19:29:53.067247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 52/120] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:52 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:53.226986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:53.228290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:53.273331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:53.276975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:53.278656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:53.279358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:53.619095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:53.635629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:53.645996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:53.647773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c245b6f-385a-4fcf-9681-2f69b3a3ce19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.427466 Apr 20 19:29:53.648404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 69/121] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:53 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:53.919875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:53.920558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:53.948341 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:53.948919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:53.949806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:53.950314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:54.084112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:54.085283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:54.095464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:54.096307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:54.097669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:54.098378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:54.348173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:54.363228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3bcbffff-a9f6-4daa-b921-f28e7f13c8d4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.446010 Apr 20 19:29:54.378660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 53/122] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:53 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:54.502225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:54.513077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-15a0f461-bedc-4eaf-ab78-7f6743831690 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.433248 Apr 20 19:29:54.515763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 70/123] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:54 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:54.670384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:54.671494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:54.682307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:54.682825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:54.683744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:54.684253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:55.047248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:55.057755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:55.059427 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:55.061127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-409970cb-33a7-4a90-b682-267815dd92cb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1406 microversion: 2.20 time: 0.397511 Apr 20 19:29:55.062183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 54/124] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:54 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:29:55.146933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-95680d2a-b1a4-4e2b-8b74-88cc818f8bf7 req-b690ed3e-a1b2-4d9c-a473-d5361a6bab84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ed4913-e7ef-455c-9061-477f1274e3b7", "name": "network-vif-plugged", "status": "completed", "tag": "8e197005-0c8e-41e1-ac1e-defb1c9d189c"}, {"server_uuid": "b5c66822-12bf-4406-b7d7-8da089316106", "name": "network-vif-plugged", "status": "completed", "tag": "8b80eb18-b82a-4b8e-a9d4-1f24cd0c8a5a"}, {"server_uuid": "c9c99e67-a6e2-4f90-bb81-d4e3f368f1de", "name": "network-vif-plugged", "status": "completed", "tag": "7dd320e4-5118-4b15-8942-5329b2b163c1"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:55.149024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:55.149024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:55.174978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-95680d2a-b1a4-4e2b-8b74-88cc818f8bf7 req-b690ed3e-a1b2-4d9c-a473-d5361a6bab84 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:55.177741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-95680d2a-b1a4-4e2b-8b74-88cc818f8bf7 req-b690ed3e-a1b2-4d9c-a473-d5361a6bab84 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:55.233183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-95680d2a-b1a4-4e2b-8b74-88cc818f8bf7 req-b690ed3e-a1b2-4d9c-a473-d5361a6bab84 service nova] Creating event network-vif-plugged:8e197005-0c8e-41e1-ac1e-defb1c9d189c for instance d9ed4913-e7ef-455c-9061-477f1274e3b7 on hv-cinder-78726 Apr 20 19:29:55.234250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-95680d2a-b1a4-4e2b-8b74-88cc818f8bf7 req-b690ed3e-a1b2-4d9c-a473-d5361a6bab84 service nova] Creating event network-vif-plugged:8b80eb18-b82a-4b8e-a9d4-1f24cd0c8a5a for instance b5c66822-12bf-4406-b7d7-8da089316106 on hv-cinder-78726 Apr 20 19:29:55.235111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-95680d2a-b1a4-4e2b-8b74-88cc818f8bf7 req-b690ed3e-a1b2-4d9c-a473-d5361a6bab84 service nova] Creating event network-vif-plugged:7dd320e4-5118-4b15-8942-5329b2b163c1 for instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de on hv-cinder-78726 Apr 20 19:29:55.247077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-95680d2a-b1a4-4e2b-8b74-88cc818f8bf7 req-b690ed3e-a1b2-4d9c-a473-d5361a6bab84 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.105909 Apr 20 19:29:55.248342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 71/125] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:55 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:29:55.398216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:55.399478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:55.409960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:55.410411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:55.411135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:55.411653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:55.534126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:55.535187 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:55.574239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:55.574753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:55.575628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:55.576133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:56.482043 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:56.494997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88792348-c165-487f-acf1-2e3a577b1d89 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.965380 Apr 20 19:29:56.495885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:56.496513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 72/126] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:55 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:56.503736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:56.504569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:56.514375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:56.515213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:56.516237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:56.517149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:56.528344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f9fdb82-9544-43c1-980a-976b10b0afa7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 1.135923 Apr 20 19:29:56.531488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 55/127] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:55 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:56.818441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:56.828370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:56.830156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:56.831386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6757aa25-36b7-437a-bf7c-7d710dec0449 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1597 microversion: 2.20 time: 0.333478 Apr 20 19:29:56.832013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 73/128] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:29:56 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1597 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:29:56.853830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9eadb992-3486-4d3d-8ddd-0d386bb0f989 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:56.854396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9eadb992-3486-4d3d-8ddd-0d386bb0f989 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:56.863340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eadb992-3486-4d3d-8ddd-0d386bb0f989 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:56.863988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eadb992-3486-4d3d-8ddd-0d386bb0f989 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:56.864947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eadb992-3486-4d3d-8ddd-0d386bb0f989 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:56.865587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9eadb992-3486-4d3d-8ddd-0d386bb0f989 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:57.057408 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9eadb992-3486-4d3d-8ddd-0d386bb0f989 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.209913 Apr 20 19:29:57.058323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 56/129] 10.222.0.38 () {60 vars in 1306 bytes} [Tue Apr 20 19:29:56 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:29:57.513828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:57.515313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:57.524485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:57.525449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:57.526656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:57.527357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:57.549778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:57.550806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:57.564192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:57.569104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:57.570226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:57.570925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:58.335432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:58.340200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:58.353910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a1c4b5c9-7c42-4396-94a2-a7d758945822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.844327 Apr 20 19:29:58.358046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 74/130] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:57 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:58.362996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d6dc4b23-1ff7-438c-927f-1f2aebec12bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.815435 Apr 20 19:29:58.366045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 57/131] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:57 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:59.374756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:59.375450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:59.384922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:59.385053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:29:59.385230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:59.385562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:59.386428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:59.387077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:59.405973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:59.406490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:59.407340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:59.408006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:59.941197 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:59.941987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:29:59.953457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-240ac238-2a6e-4807-91a0-6f70e15dfac2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.573665 Apr 20 19:29:59.953756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3d2a98b-799d-4356-b54e-cb16f10ef928 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.582653 Apr 20 19:29:59.954610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 58/133] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:59 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:59.957243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 75/133] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:29:59 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:29:59.966081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9005ca7-f237-4bdc-a911-7fe3fde5bdcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:59.968767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-09b600f1-93cc-4bb2-b4ac-1741260a33e3 req-e374418e-09f1-42f7-a867-a88f56e8fd9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ca897f-86b0-4162-a72d-2a399eef0f34", "tag": "22a8b0f9-0716-4893-9db4-55b6fdf5988e"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:29:59.970320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9005ca7-f237-4bdc-a911-7fe3fde5bdcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:29:59.970972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:29:59.970972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:29:59.981580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-09b600f1-93cc-4bb2-b4ac-1741260a33e3 req-e374418e-09f1-42f7-a867-a88f56e8fd9b service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:59.982089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-09b600f1-93cc-4bb2-b4ac-1741260a33e3 req-e374418e-09f1-42f7-a867-a88f56e8fd9b service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:59.982943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9005ca7-f237-4bdc-a911-7fe3fde5bdcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:59.983662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9005ca7-f237-4bdc-a911-7fe3fde5bdcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:29:59.985176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9005ca7-f237-4bdc-a911-7fe3fde5bdcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:29:59.986959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9005ca7-f237-4bdc-a911-7fe3fde5bdcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:00.002846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-09b600f1-93cc-4bb2-b4ac-1741260a33e3 req-e374418e-09f1-42f7-a867-a88f56e8fd9b service nova] Creating event network-changed:22a8b0f9-0716-4893-9db4-55b6fdf5988e for instance 75ca897f-86b0-4162-a72d-2a399eef0f34 on hv-cinder-78726 Apr 20 19:30:00.009102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-09b600f1-93cc-4bb2-b4ac-1741260a33e3 req-e374418e-09f1-42f7-a867-a88f56e8fd9b service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048590 Apr 20 19:30:00.009974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 76/134] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:29:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:00.580925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9005ca7-f237-4bdc-a911-7fe3fde5bdcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.624491 Apr 20 19:30:00.586426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 59/135] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:29:59 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:00.972978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:00.973203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:00.974050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:00.975163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:00.986013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:00.986796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:00.987828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:00.988496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:00.989417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:00.993148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:00.996316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:00.998341 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:01.462203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:01.473098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a65a9a68-bb37-47fa-9d78-64ab522274a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.504912 Apr 20 19:30:01.473606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 60/136] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:00 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:01.533814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:01.545162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0b56593e-434b-48bb-859d-860a867557d2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1322 microversion: 2.1 time: 0.577151 Apr 20 19:30:01.546108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 77/137] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:00 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:01.592772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c37f3e17-0117-4b31-891c-fa65386d52f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:01.593863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c37f3e17-0117-4b31-891c-fa65386d52f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:01.603486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c37f3e17-0117-4b31-891c-fa65386d52f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:01.604127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c37f3e17-0117-4b31-891c-fa65386d52f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:01.605183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c37f3e17-0117-4b31-891c-fa65386d52f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:01.605863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c37f3e17-0117-4b31-891c-fa65386d52f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:01.967447 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c37f3e17-0117-4b31-891c-fa65386d52f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.379160 Apr 20 19:30:01.968162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 61/138] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:01 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:02.216454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2028624809", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "94eaea9d-e39c-47da-9fde-443a214825c9"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:02.317053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] validate_networks() for [('94eaea9d-e39c-47da-9fde-443a214825c9', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:30:02.493612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:02.494920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:02.511226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:02.511751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:02.514782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:02.515392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.080870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:03.090492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-593bbf11-e2f4-4cac-a52d-9eb58093aef7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1361 microversion: 2.1 time: 0.602816 Apr 20 19:30:03.091101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 62/139] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:02 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1361 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:03.099452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:03.100079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:03.107738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.108264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.109199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.109697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.116247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:30:03.116758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:30:03.117306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:30:03.117861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:30:03.118220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:30:03.127099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.127614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.128504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.129032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.154867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:30:03.159229 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for user 6b2a4b1c9ccc4943bc354e2702f6db24 and project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:30:03.179012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:30:03.181754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:30:03.250923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a9382fee-e429-44d5-b7b6-966c44730c64 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040057 Apr 20 19:30:03.257026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 78/140] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:30:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:30:03.266874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e0975818-5acb-4025-bd52-8a51e52bae0f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:03.268059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e0975818-5acb-4025-bd52-8a51e52bae0f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:03.283788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0975818-5acb-4025-bd52-8a51e52bae0f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.284494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0975818-5acb-4025-bd52-8a51e52bae0f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.286916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0975818-5acb-4025-bd52-8a51e52bae0f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.287423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0975818-5acb-4025-bd52-8a51e52bae0f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.433490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:03.439388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e0975818-5acb-4025-bd52-8a51e52bae0f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.179636 Apr 20 19:30:03.440423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 79/141] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:03 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:03.447931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-332e69d1-a3bd-4e28-98d4-94432454e9fd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:03.454708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-332e69d1-a3bd-4e28-98d4-94432454e9fd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:03.457618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8823fe29-4c51-4a35-a638-fc9d711803a8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1515 microversion: 2.1 time: 0.362030 Apr 20 19:30:03.477433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 63/142] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:03 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:03.493179 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:03.494573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:03.511558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.512198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.513170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.514177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.596741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lazy-loading 'flavor' on Instance uuid b5c66822-12bf-4406-b7d7-8da089316106 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:30:03.609603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-332e69d1-a3bd-4e28-98d4-94432454e9fd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:03.621419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-332e69d1-a3bd-4e28-98d4-94432454e9fd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1218 microversion: 2.1 time: 0.179531 Apr 20 19:30:03.624679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 80/143] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:03 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:03.780214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-90cc9bba-dfb7-4748-a119-e02a0c5f36d4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106/action" status: 200 len: 32 microversion: 2.1 time: 0.301120 Apr 20 19:30:03.780918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 64/144] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:03 2021] POST /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:03.791351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:03.792244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:03.819479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.820067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:03.821024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:03.821519 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.121629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:04.124313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:04.150078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.151836 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.152872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.156352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.224002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:04.243455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b1e4e5f9-834e-4a81-ac99-3a218a52ce79 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.456559 Apr 20 19:30:04.244084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 81/145] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:03 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:04.453542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c8eb91d6-6c6b-452d-8d7e-661384800eb5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:04.455550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c8eb91d6-6c6b-452d-8d7e-661384800eb5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:04.464139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:04.466604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8eb91d6-6c6b-452d-8d7e-661384800eb5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.467321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8eb91d6-6c6b-452d-8d7e-661384800eb5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.468364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8eb91d6-6c6b-452d-8d7e-661384800eb5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.469076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8eb91d6-6c6b-452d-8d7e-661384800eb5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.473446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2216183b-83ca-4548-b779-20b32bbe4a18 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1547 microversion: 2.1 time: 0.368668 Apr 20 19:30:04.474137 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 65/146] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:04 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1547 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:04.491910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9bc231ad-db9c-4f04-9b74-2f4a0d39b9f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:04.492439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9bc231ad-db9c-4f04-9b74-2f4a0d39b9f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:04.500838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bc231ad-db9c-4f04-9b74-2f4a0d39b9f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.501353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bc231ad-db9c-4f04-9b74-2f4a0d39b9f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.502216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bc231ad-db9c-4f04-9b74-2f4a0d39b9f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.502710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bc231ad-db9c-4f04-9b74-2f4a0d39b9f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.650495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c8eb91d6-6c6b-452d-8d7e-661384800eb5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.192959 Apr 20 19:30:04.650495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 82/147] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:04 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:04.655553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:04.656989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:04.665147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.665763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.666707 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:04.667870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:04.679128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9bc231ad-db9c-4f04-9b74-2f4a0d39b9f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191512 Apr 20 19:30:04.680399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 66/148] 10.222.0.38 () {58 vars in 1265 bytes} [Tue Apr 20 19:30:04 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:30:04.930661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:04.947007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9866548f-8406-4918-94ed-2463c29546fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1270 microversion: 2.1 time: 0.301624 Apr 20 19:30:04.947898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 83/149] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:04 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:05.262373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:05.266400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:05.284258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:05.287529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:05.288633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:05.289352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:05.657064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-270a9bc1-2969-4ac0-8105-facbcca69ca5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:05.658400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-270a9bc1-2969-4ac0-8105-facbcca69ca5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:05.674018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-270a9bc1-2969-4ac0-8105-facbcca69ca5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:05.675377 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-270a9bc1-2969-4ac0-8105-facbcca69ca5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:05.678524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-270a9bc1-2969-4ac0-8105-facbcca69ca5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:05.679711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-270a9bc1-2969-4ac0-8105-facbcca69ca5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:05.907936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-270a9bc1-2969-4ac0-8105-facbcca69ca5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.256243 Apr 20 19:30:05.908981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 84/150] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:05 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:05.966147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:05.966930 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:05.985912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:05.986580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:05.987613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:05.988256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:06.382888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:06.397101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-52ee0d03-7988-4690-8e54-aa551d68fe80 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1276 microversion: 2.1 time: 0.435517 Apr 20 19:30:06.398122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 85/151] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:05 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1276 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:06.514768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:06.532539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed9f8fed-2bd6-462c-82df-6bc8ea3ce2b3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 1.274398 Apr 20 19:30:06.533511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 67/152] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:05 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:06.920643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-70ead6cc-61dd-4463-96c2-1bea8e12d35c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:06.922181 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-70ead6cc-61dd-4463-96c2-1bea8e12d35c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:06.930721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70ead6cc-61dd-4463-96c2-1bea8e12d35c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:06.931732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70ead6cc-61dd-4463-96c2-1bea8e12d35c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:06.933241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70ead6cc-61dd-4463-96c2-1bea8e12d35c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:06.933976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70ead6cc-61dd-4463-96c2-1bea8e12d35c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:07.110293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-70ead6cc-61dd-4463-96c2-1bea8e12d35c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.193648 Apr 20 19:30:07.111324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 86/153] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:06 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:07.417412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:07.417960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:07.434241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:07.435728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:07.437142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:07.437858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:07.554415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:07.555773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:07.567822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:07.569295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:07.570809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:07.571525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:07.672603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:07.684827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-be905110-7133-46fa-af9e-80b5d9146941 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1276 microversion: 2.1 time: 0.271701 Apr 20 19:30:07.694281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 68/154] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:07 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:08.122990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c16a486e-7eec-4fcd-8773-9563d4602b79 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:08.124044 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c16a486e-7eec-4fcd-8773-9563d4602b79 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:08.133290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c16a486e-7eec-4fcd-8773-9563d4602b79 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:08.134092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c16a486e-7eec-4fcd-8773-9563d4602b79 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:08.135143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c16a486e-7eec-4fcd-8773-9563d4602b79 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:08.135820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c16a486e-7eec-4fcd-8773-9563d4602b79 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:08.311580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c16a486e-7eec-4fcd-8773-9563d4602b79 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.193435 Apr 20 19:30:08.312650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 69/155] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:08 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:08.322554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:08.338620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1ba0c658-5441-4d1c-b56e-c30d0ca348d9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.790849 Apr 20 19:30:08.344997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 87/156] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:07 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:08.571205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6b3733d-dd27-4ac8-be59-dc5c66abced2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:08.572950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6b3733d-dd27-4ac8-be59-dc5c66abced2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:08.588550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c82381cc-e637-4322-9452-83b234f9b74b req-c7fe3342-1db4-46b4-a310-bcc309f06843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ed4913-e7ef-455c-9061-477f1274e3b7", "tag": "8e197005-0c8e-41e1-ac1e-defb1c9d189c"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:08.590388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:08.590388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:30:08.613089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6b3733d-dd27-4ac8-be59-dc5c66abced2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:08.613610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6b3733d-dd27-4ac8-be59-dc5c66abced2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:08.614554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6b3733d-dd27-4ac8-be59-dc5c66abced2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:08.615040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6b3733d-dd27-4ac8-be59-dc5c66abced2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:08.619323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c82381cc-e637-4322-9452-83b234f9b74b req-c7fe3342-1db4-46b4-a310-bcc309f06843 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:08.619808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c82381cc-e637-4322-9452-83b234f9b74b req-c7fe3342-1db4-46b4-a310-bcc309f06843 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:08.683331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c82381cc-e637-4322-9452-83b234f9b74b req-c7fe3342-1db4-46b4-a310-bcc309f06843 service nova] Creating event network-changed:8e197005-0c8e-41e1-ac1e-defb1c9d189c for instance d9ed4913-e7ef-455c-9061-477f1274e3b7 on hv-cinder-78726 Apr 20 19:30:08.702498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c82381cc-e637-4322-9452-83b234f9b74b req-c7fe3342-1db4-46b4-a310-bcc309f06843 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117632 Apr 20 19:30:08.703274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 88/157] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:08.712190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:08.716677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:08.738293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:08.738806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:08.739724 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:08.740224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:08.910532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6b3733d-dd27-4ac8-be59-dc5c66abced2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.344707 Apr 20 19:30:08.911565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 70/158] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:08 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:09.246806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:09.247748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:09.262363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:09.267921 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:09.268980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:09.269655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:09.417542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:30:09.668397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3fe74ac6-21d2-4b8a-bd23-3d51b0ef63dd tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "DELETE /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 204 len: 0 microversion: 2.1 time: 0.425676 Apr 20 19:30:09.674524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 71/159] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:30:09 2021] DELETE /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 19:30:09.681776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5b7c9c1-c565-4a3c-aaf6-984b9b9696ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:09.683246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5b7c9c1-c565-4a3c-aaf6-984b9b9696ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:09.693091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b7c9c1-c565-4a3c-aaf6-984b9b9696ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:09.694083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b7c9c1-c565-4a3c-aaf6-984b9b9696ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:09.695882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b7c9c1-c565-4a3c-aaf6-984b9b9696ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:09.696583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5b7c9c1-c565-4a3c-aaf6-984b9b9696ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:09.917477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5b7c9c1-c565-4a3c-aaf6-984b9b9696ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.240527 Apr 20 19:30:09.918494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 72/160] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:09 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:09.926196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:09.929431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:09.955258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:09.956455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:09.959669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:09.963987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:10.579876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:10.594302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d761bc5-dd0e-4a30-be86-35f4bd718ede tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 1.886952 Apr 20 19:30:10.596145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 89/161] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:08 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:10.609935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:10.610823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:10.626610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:10.635799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:10.637003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:10.637652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:11.093761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:11.104329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6edd65c4-f05d-47dd-a413-6ae37d08f3a1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 1.184315 Apr 20 19:30:11.108185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 73/162] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:09 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:11.120235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b7b054c6-6014-41b9-9b8d-76e4ff920270 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:11.121581 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b7b054c6-6014-41b9-9b8d-76e4ff920270 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:11.134266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7b054c6-6014-41b9-9b8d-76e4ff920270 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:11.135316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7b054c6-6014-41b9-9b8d-76e4ff920270 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:11.136944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7b054c6-6014-41b9-9b8d-76e4ff920270 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:11.138016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7b054c6-6014-41b9-9b8d-76e4ff920270 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:11.232394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:11.257153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2acc651c-ff02-4b96-9394-d4882ba3f9fe tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1554 microversion: 2.1 time: 0.659638 Apr 20 19:30:11.259989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 90/163] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:10 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1554 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:11.271067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-168e1475-f557-4290-964e-6a76bdb0ad55 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:11.274023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-168e1475-f557-4290-964e-6a76bdb0ad55 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:11.284354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-168e1475-f557-4290-964e-6a76bdb0ad55 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:11.285538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-168e1475-f557-4290-964e-6a76bdb0ad55 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:11.287450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-168e1475-f557-4290-964e-6a76bdb0ad55 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:11.288267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-168e1475-f557-4290-964e-6a76bdb0ad55 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:11.372275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b7b054c6-6014-41b9-9b8d-76e4ff920270 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.261997 Apr 20 19:30:11.373371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 74/164] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:11 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:11.463869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-168e1475-f557-4290-964e-6a76bdb0ad55 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.197035 Apr 20 19:30:11.465103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 91/165] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:11 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:11.479554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-0a56ff38-b4a8-4def-8dea-9bce2531cffc req-05f84118-d8a0-430a-b2da-bda68789ba62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bfed580-15db-4f05-a50f-cb8fbfad6b39", "tag": "e7c3b303-1f91-4666-9c18-e7c69424a700"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:11.481544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:11.481544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:30:11.492022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0a56ff38-b4a8-4def-8dea-9bce2531cffc req-05f84118-d8a0-430a-b2da-bda68789ba62 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:11.492821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0a56ff38-b4a8-4def-8dea-9bce2531cffc req-05f84118-d8a0-430a-b2da-bda68789ba62 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:11.511888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-0a56ff38-b4a8-4def-8dea-9bce2531cffc req-05f84118-d8a0-430a-b2da-bda68789ba62 service nova] Creating event network-changed:e7c3b303-1f91-4666-9c18-e7c69424a700 for instance 1bfed580-15db-4f05-a50f-cb8fbfad6b39 on hv-cinder-78726 Apr 20 19:30:11.517443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-0a56ff38-b4a8-4def-8dea-9bce2531cffc req-05f84118-d8a0-430a-b2da-bda68789ba62 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043318 Apr 20 19:30:11.518697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 75/166] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:11.613485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:11.614899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:11.623740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:11.624586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:11.625643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:11.626297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.063601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:12.076324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-12ba6cca-9b49-470f-b24b-4f0787e72c9b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.467343 Apr 20 19:30:12.076972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 92/167] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:11 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:12.128045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:12.129373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:12.142586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.143544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.145054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.146926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.278444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:12.279397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:12.288751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.289544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.290402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.290907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.897089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:12.904310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:12.906751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1dea59f4-c956-446e-844d-6a90a95d868c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.784561 Apr 20 19:30:12.915827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cbd996d1-b5ea-4d3e-afb9-9989b8987da7 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1554 microversion: 2.1 time: 0.641628 Apr 20 19:30:12.916543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 93/168] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:12 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1554 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:12.918096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 76/169] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:12 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:12.923211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25781d96-58d1-48e3-97d2-ad1c4b4ea5d7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:12.924320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-25781d96-58d1-48e3-97d2-ad1c4b4ea5d7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:12.930514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-61145c2d-e024-4ed1-bdb5-e84a057fe645 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:12.931567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-61145c2d-e024-4ed1-bdb5-e84a057fe645 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:12.933136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25781d96-58d1-48e3-97d2-ad1c4b4ea5d7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.933751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25781d96-58d1-48e3-97d2-ad1c4b4ea5d7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.934707 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25781d96-58d1-48e3-97d2-ad1c4b4ea5d7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.935290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25781d96-58d1-48e3-97d2-ad1c4b4ea5d7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.940232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61145c2d-e024-4ed1-bdb5-e84a057fe645 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.940750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61145c2d-e024-4ed1-bdb5-e84a057fe645 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:12.941626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61145c2d-e024-4ed1-bdb5-e84a057fe645 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:12.942125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61145c2d-e024-4ed1-bdb5-e84a057fe645 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:13.172845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-61145c2d-e024-4ed1-bdb5-e84a057fe645 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.247875 Apr 20 19:30:13.173770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 94/170] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:12 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:13.181007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:13.181812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:13.190652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:13.191178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:13.192092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:13.193267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:13.205797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-25781d96-58d1-48e3-97d2-ad1c4b4ea5d7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 14 microversion: 2.20 time: 0.286139 Apr 20 19:30:13.206485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 77/171] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:12 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 14 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:13.554143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:13.566279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c409613e-9150-4dc8-a4c9-0c93f0c67bbb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.391224 Apr 20 19:30:13.567540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 95/172] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:13 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:13.930958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:13.932052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:13.934640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:13.935470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:13.948607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:13.954547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:13.955254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:13.955444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:13.956156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:13.956664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:13.956844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:13.957474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.569916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:14.584482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-22abd9b0-2ea0-4eff-955a-f7e3466a942a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.658235 Apr 20 19:30:14.595384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 78/173] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:13 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:14.602375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3cf86858-81c5-438a-b9d6-0aca01251322 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:14.603534 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3cf86858-81c5-438a-b9d6-0aca01251322 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:14.612343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cf86858-81c5-438a-b9d6-0aca01251322 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:14.613118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cf86858-81c5-438a-b9d6-0aca01251322 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.615117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cf86858-81c5-438a-b9d6-0aca01251322 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:14.616334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cf86858-81c5-438a-b9d6-0aca01251322 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.660739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:14.671276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d7a7c312-61db-4bbb-8b58-3f8a7c2c30e6 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1554 microversion: 2.1 time: 0.740842 Apr 20 19:30:14.682736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 96/174] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:13 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1554 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:14.688101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cd7a16d9-968e-411f-82e2-352d9ff79e46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:14.690174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cd7a16d9-968e-411f-82e2-352d9ff79e46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:14.700370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd7a16d9-968e-411f-82e2-352d9ff79e46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:14.701209 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd7a16d9-968e-411f-82e2-352d9ff79e46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.704140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd7a16d9-968e-411f-82e2-352d9ff79e46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:14.704862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd7a16d9-968e-411f-82e2-352d9ff79e46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.774541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3cf86858-81c5-438a-b9d6-0aca01251322 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.177541 Apr 20 19:30:14.777986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 79/175] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:14 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:14.782627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:14.783471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:14.793699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:14.794243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.795106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:14.795591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.883750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cd7a16d9-968e-411f-82e2-352d9ff79e46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 12971 microversion: 2.20 time: 0.198894 Apr 20 19:30:14.884579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 97/176] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:14 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 12971 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:14.910015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-063886b3-75ca-495b-a34e-7a55cec3aff9 req-87177597-e1f1-4f6a-9525-6cca992feb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58c9af7-b045-4297-8a28-31e6301db247", "name": "network-vif-deleted", "tag": "f0995049-fd0b-42d5-9ca2-b48ccf5db473"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:14.912788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:14.912788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:30:14.923712 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-063886b3-75ca-495b-a34e-7a55cec3aff9 req-87177597-e1f1-4f6a-9525-6cca992feb91 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:14.924635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-063886b3-75ca-495b-a34e-7a55cec3aff9 req-87177597-e1f1-4f6a-9525-6cca992feb91 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:14.951000 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-063886b3-75ca-495b-a34e-7a55cec3aff9 req-87177597-e1f1-4f6a-9525-6cca992feb91 service nova] Creating event network-vif-deleted:f0995049-fd0b-42d5-9ca2-b48ccf5db473 for instance f58c9af7-b045-4297-8a28-31e6301db247 on hv-cinder-78726 Apr 20 19:30:14.960294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-063886b3-75ca-495b-a34e-7a55cec3aff9 req-87177597-e1f1-4f6a-9525-6cca992feb91 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055168 Apr 20 19:30:14.961079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 98/177] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:15.027605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:15.037529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9364e4ef-be0e-4c17-bbc2-01fdbbb1f180 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.260517 Apr 20 19:30:15.038328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 80/178] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:14 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:15.603924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:15.605244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:15.615310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.615873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.616800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.617241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.693805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:15.694514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:15.712018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.712823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.713935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.714734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.843065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.845441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.847772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lazy-loading 'fault' on Instance uuid f58c9af7-b045-4297-8a28-31e6301db247 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:30:15.945414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bbdd3bbdb34132b689790ee5e534e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7d571d2ace4ec4813cdc944b1af495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:15.948798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:15.960369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-73a0cc2c-d618-4f3b-a6e0-f1ee97f9ee2f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.361297 Apr 20 19:30:15.961348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 99/179] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:15 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:15.963531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc01fcae-acf6-42d2-9305-b84719766833 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 200 len: 1351 microversion: 2.1 time: 0.277742 Apr 20 19:30:15.964167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 81/180] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:15 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 1351 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:15.976359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a0f58b95-0d99-4d15-a9d4-2b40781da328 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:15.977623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-23d17922-d8c4-44dc-8e74-c82b1c43c159 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:15.978743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a0f58b95-0d99-4d15-a9d4-2b40781da328 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:15.979156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-23d17922-d8c4-44dc-8e74-c82b1c43c159 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:15.987778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23d17922-d8c4-44dc-8e74-c82b1c43c159 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.988290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23d17922-d8c4-44dc-8e74-c82b1c43c159 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.989231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23d17922-d8c4-44dc-8e74-c82b1c43c159 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.989737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23d17922-d8c4-44dc-8e74-c82b1c43c159 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.993145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f58b95-0d99-4d15-a9d4-2b40781da328 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.993648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f58b95-0d99-4d15-a9d4-2b40781da328 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:15.994505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f58b95-0d99-4d15-a9d4-2b40781da328 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:15.995155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f58b95-0d99-4d15-a9d4-2b40781da328 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:16.175531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a0f58b95-0d99-4d15-a9d4-2b40781da328 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.212142 Apr 20 19:30:16.176221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 100/181] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:15 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:16.182582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:16.183425 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:16.192277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:16.193291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:16.194321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:16.194813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:16.215622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-23d17922-d8c4-44dc-8e74-c82b1c43c159 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 17960 microversion: 2.20 time: 0.250046 Apr 20 19:30:16.216628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 82/182] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:15 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 17960 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:16.572904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:16.582295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0b49b3d0-d2fa-4dc5-805c-5532daceb3eb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.404685 Apr 20 19:30:16.588859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 101/183] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:16 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:16.982162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:16.982639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:16.982765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:16.983380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:16.995857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:16.996382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:16.997654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:16.998157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.021455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.022271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.023915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.025351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.136345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] HTTP exception thrown: Instance f58c9af7-b045-4297-8a28-31e6301db247 could not be found. Apr 20 19:30:17.139970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Returning 404 to user: Instance f58c9af7-b045-4297-8a28-31e6301db247 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:30:17.140873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2cb725ac-7036-4562-bee2-d7a1434bb0ad tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 404 len: 111 microversion: 2.1 time: 0.162745 Apr 20 19:30:17.141495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 102/184] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:16 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:30:17.188481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-31ee6fce-ea8a-4a89-8903-a52d39b2cc1f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:17.189707 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-31ee6fce-ea8a-4a89-8903-a52d39b2cc1f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:17.201366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31ee6fce-ea8a-4a89-8903-a52d39b2cc1f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.202334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31ee6fce-ea8a-4a89-8903-a52d39b2cc1f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.203686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31ee6fce-ea8a-4a89-8903-a52d39b2cc1f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.204605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-31ee6fce-ea8a-4a89-8903-a52d39b2cc1f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.378090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-31ee6fce-ea8a-4a89-8903-a52d39b2cc1f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.193922 Apr 20 19:30:17.379527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 103/185] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:17 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 19:30:17.386073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1a05aae1-8be5-4fd7-9e3b-8d74e74c71f6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:17.391308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1a05aae1-8be5-4fd7-9e3b-8d74e74c71f6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:17.402019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a05aae1-8be5-4fd7-9e3b-8d74e74c71f6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.403281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a05aae1-8be5-4fd7-9e3b-8d74e74c71f6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.404868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a05aae1-8be5-4fd7-9e3b-8d74e74c71f6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.405602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a05aae1-8be5-4fd7-9e3b-8d74e74c71f6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.459018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:17.469087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34ac0aa5-09b3-469d-b1bf-5b0d3f6bec21 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.493309 Apr 20 19:30:17.473921 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 83/186] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:16 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:17.604789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:17.606669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:17.621919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.622408 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.623499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:17.624076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:17.642286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1a05aae1-8be5-4fd7-9e3b-8d74e74c71f6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 19133 microversion: 2.20 time: 0.260289 Apr 20 19:30:17.643722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 104/187] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:17 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 19133 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:18.081972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:18.091869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8c9d54da-4c16-415a-aff2-5ad970e9a726 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.494825 Apr 20 19:30:18.092516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 84/188] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:17 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:18.391378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-425f0a02-0ddc-4ee5-a51e-55bcb1a160b3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:18.392537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-425f0a02-0ddc-4ee5-a51e-55bcb1a160b3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:18.401918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-425f0a02-0ddc-4ee5-a51e-55bcb1a160b3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:18.402364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-425f0a02-0ddc-4ee5-a51e-55bcb1a160b3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:18.403272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-425f0a02-0ddc-4ee5-a51e-55bcb1a160b3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:18.403778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-425f0a02-0ddc-4ee5-a51e-55bcb1a160b3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:18.492258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:18.493311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:18.504028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:18.504806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:18.505769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:18.506127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:18.568998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-425f0a02-0ddc-4ee5-a51e-55bcb1a160b3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.181905 Apr 20 19:30:18.572098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 105/189] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:18 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:18.656694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b6b552af-941a-4181-ac45-54d3d17dce9d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:18.657849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b6b552af-941a-4181-ac45-54d3d17dce9d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:18.667025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6b552af-941a-4181-ac45-54d3d17dce9d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:18.667543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6b552af-941a-4181-ac45-54d3d17dce9d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:18.668402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6b552af-941a-4181-ac45-54d3d17dce9d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:18.668928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6b552af-941a-4181-ac45-54d3d17dce9d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:18.821350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:18.830503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9078ba3c-6dbb-484e-8974-82b18f544520 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.342777 Apr 20 19:30:18.841761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 85/190] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:18 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:18.842153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b6b552af-941a-4181-ac45-54d3d17dce9d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 20991 microversion: 2.20 time: 0.188546 Apr 20 19:30:18.843119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 106/191] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:18 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 20991 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:30:19.112700 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:19.113851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:19.122637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.123558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.124521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.125687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.140896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:19.141575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:19.152410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.153006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.153883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.154389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.230629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] HTTP exception thrown: Instance f58c9af7-b045-4297-8a28-31e6301db247 could not be found. Apr 20 19:30:19.231595 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Returning 404 to user: Instance f58c9af7-b045-4297-8a28-31e6301db247 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:30:19.232745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7bffc3ae-9412-48c3-a30d-b9f65817fb22 tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "DELETE /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 404 len: 111 microversion: 2.1 time: 0.096428 Apr 20 19:30:19.233632 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 107/192] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:30:19 2021] DELETE /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:30:19.246799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:19.247672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] [instance: f58c9af7-b045-4297-8a28-31e6301db247] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:19.255906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.256423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.257453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.257962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.328433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] HTTP exception thrown: Instance f58c9af7-b045-4297-8a28-31e6301db247 could not be found. Apr 20 19:30:19.329138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] Returning 404 to user: Instance f58c9af7-b045-4297-8a28-31e6301db247 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:30:19.330038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-795f53e2-0be3-4072-b8a7-17bafc88fa8c tempest-DeleteServersTestJSON-322214442 tempest-DeleteServersTestJSON-322214442-project] 10.222.0.38 "GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247" status: 404 len: 111 microversion: 2.1 time: 0.087342 Apr 20 19:30:19.330802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 108/193] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:19 2021] GET /compute/v2.1/servers/f58c9af7-b045-4297-8a28-31e6301db247 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:30:19.389872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:19.399420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3e226744-606b-4d2d-b151-75ef3d24ae2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.292005 Apr 20 19:30:19.400306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 86/194] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:19 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:19.585399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3e2282c9-178d-4dd0-8aae-2619f86161f7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:19.585399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e2282c9-178d-4dd0-8aae-2619f86161f7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:19.592986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2282c9-178d-4dd0-8aae-2619f86161f7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.593919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2282c9-178d-4dd0-8aae-2619f86161f7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.594405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2282c9-178d-4dd0-8aae-2619f86161f7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.594849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2282c9-178d-4dd0-8aae-2619f86161f7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.760132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3e2282c9-178d-4dd0-8aae-2619f86161f7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 14 microversion: 2.1 time: 0.180895 Apr 20 19:30:19.761203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 109/195] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:19 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:30:19.850061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:19.850061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:19.855852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0ff80d91-8548-4063-a4ba-ce96e516b105 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:19.857042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0ff80d91-8548-4063-a4ba-ce96e516b105 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:19.878198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.882867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ff80d91-8548-4063-a4ba-ce96e516b105 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.883399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ff80d91-8548-4063-a4ba-ce96e516b105 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.884412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ff80d91-8548-4063-a4ba-ce96e516b105 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.890305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.891263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:19.891784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:19.895645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0ff80d91-8548-4063-a4ba-ce96e516b105 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:20.075023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0ff80d91-8548-4063-a4ba-ce96e516b105 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 22379 microversion: 2.20 time: 0.223572 Apr 20 19:30:20.076527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 110/196] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:19 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 22379 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:30:20.156552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:20.167085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72e9b26d-b606-44b1-8613-e0a2647d56e9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.322824 Apr 20 19:30:20.167900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 87/197] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:19 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:20.419444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:20.420494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:20.433903 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:20.434408 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:20.435268 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:20.436082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:20.714626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:20.725909 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-24f3681e-a9e9-4afe-94d3-5e69da39787f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.310924 Apr 20 19:30:20.726538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 111/198] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:20 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:20.778236 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-378ebffa-aeec-4e1b-bfe1-3304380d9480 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:20.779544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-378ebffa-aeec-4e1b-bfe1-3304380d9480 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:20.800029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-378ebffa-aeec-4e1b-bfe1-3304380d9480 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:20.800462 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-378ebffa-aeec-4e1b-bfe1-3304380d9480 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:20.801684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-378ebffa-aeec-4e1b-bfe1-3304380d9480 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:20.801841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-378ebffa-aeec-4e1b-bfe1-3304380d9480 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:21.009165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-378ebffa-aeec-4e1b-bfe1-3304380d9480 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 6139 microversion: 2.1 time: 0.241050 Apr 20 19:30:21.010237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 88/199] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:20 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 6139 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:21.091664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34fe5d66-0ea6-4515-97ee-777d143b6fde tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:21.092842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34fe5d66-0ea6-4515-97ee-777d143b6fde tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:21.101993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fe5d66-0ea6-4515-97ee-777d143b6fde tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:21.102517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fe5d66-0ea6-4515-97ee-777d143b6fde tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:21.103449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fe5d66-0ea6-4515-97ee-777d143b6fde tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:21.103958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34fe5d66-0ea6-4515-97ee-777d143b6fde tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:21.176189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-78a2db66-d901-4c5a-86c1-8128bb275e8b req-f9fe41f5-6c52-44b6-96af-7ec74815e6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfed580-15db-4f05-a50f-cb8fbfad6b39", "name": "network-vif-plugged", "status": "completed", "tag": "e7c3b303-1f91-4666-9c18-e7c69424a700"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:21.180923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:21.180923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:30:21.197886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-78a2db66-d901-4c5a-86c1-8128bb275e8b req-f9fe41f5-6c52-44b6-96af-7ec74815e6d1 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:21.199402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-78a2db66-d901-4c5a-86c1-8128bb275e8b req-f9fe41f5-6c52-44b6-96af-7ec74815e6d1 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:21.226347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-78a2db66-d901-4c5a-86c1-8128bb275e8b req-f9fe41f5-6c52-44b6-96af-7ec74815e6d1 service nova] Creating event network-vif-plugged:e7c3b303-1f91-4666-9c18-e7c69424a700 for instance 1bfed580-15db-4f05-a50f-cb8fbfad6b39 on hv-cinder-78726 Apr 20 19:30:21.232979 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-78a2db66-d901-4c5a-86c1-8128bb275e8b req-f9fe41f5-6c52-44b6-96af-7ec74815e6d1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061017 Apr 20 19:30:21.233620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 89/200] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:21.242396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:21.243117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:21.251382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:21.251869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:21.252752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:21.253293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:21.303359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34fe5d66-0ea6-4515-97ee-777d143b6fde tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 23555 microversion: 2.20 time: 0.215492 Apr 20 19:30:21.305029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 112/201] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:21 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 23555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:21.535307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:21.545237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-24462d8f-8129-4315-a14a-e32afacf315f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.309633 Apr 20 19:30:21.545678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 90/202] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:21 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:21.746119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:21.747133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:21.758329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:21.759033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:21.760042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:21.760690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:22.022870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5f28af4f-feb0-4678-8859-051a79a8acfa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:22.024379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5f28af4f-feb0-4678-8859-051a79a8acfa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:22.039884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f28af4f-feb0-4678-8859-051a79a8acfa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:22.041413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f28af4f-feb0-4678-8859-051a79a8acfa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:22.042304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f28af4f-feb0-4678-8859-051a79a8acfa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:22.051698 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5f28af4f-feb0-4678-8859-051a79a8acfa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:22.058535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:22.068074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-21e35574-952b-418b-ae75-d037f7cfee2f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.326689 Apr 20 19:30:22.068696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 113/203] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:21 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:22.233391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5f28af4f-feb0-4678-8859-051a79a8acfa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 10893 microversion: 2.1 time: 0.216095 Apr 20 19:30:22.241518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 91/204] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:22 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 10893 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:22.315004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdca5613-734f-41f8-93a6-6b864b1b5f32 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:22.316485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fdca5613-734f-41f8-93a6-6b864b1b5f32 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:22.327773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdca5613-734f-41f8-93a6-6b864b1b5f32 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:22.328604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdca5613-734f-41f8-93a6-6b864b1b5f32 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:22.329685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdca5613-734f-41f8-93a6-6b864b1b5f32 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:22.330360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdca5613-734f-41f8-93a6-6b864b1b5f32 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:22.562869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fdca5613-734f-41f8-93a6-6b864b1b5f32 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 24422 microversion: 2.20 time: 0.251309 Apr 20 19:30:22.564997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:22.565832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:22.566648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 114/205] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:22 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 24422 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:22.581422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:22.582358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:22.585215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:22.600648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:22.847919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:22.857101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e1c25cd9-9255-47cb-82d3-3ce82ceba001 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.297145 Apr 20 19:30:22.858211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 92/206] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:22 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:23.087103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:23.087986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:23.096852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.097645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:23.099688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.100206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:23.246307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-209fb433-552a-4c05-82a5-eceb2709662b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:23.247371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-209fb433-552a-4c05-82a5-eceb2709662b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:23.256083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-209fb433-552a-4c05-82a5-eceb2709662b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.256605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-209fb433-552a-4c05-82a5-eceb2709662b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:23.257514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-209fb433-552a-4c05-82a5-eceb2709662b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.258176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-209fb433-552a-4c05-82a5-eceb2709662b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:23.343089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:23.352673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-22d00778-d115-48a0-adc4-dc1c5f53c690 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1318 microversion: 2.1 time: 0.270658 Apr 20 19:30:23.353581 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 115/207] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:23 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:23.439875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-209fb433-552a-4c05-82a5-eceb2709662b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 15064 microversion: 2.1 time: 0.197335 Apr 20 19:30:23.441540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 93/208] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:23 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 15064 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:30:23.580018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-047120e9-a684-46fc-aa32-4bad3c014d19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:23.582139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-047120e9-a684-46fc-aa32-4bad3c014d19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:23.591407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-047120e9-a684-46fc-aa32-4bad3c014d19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.591926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-047120e9-a684-46fc-aa32-4bad3c014d19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:23.592787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-047120e9-a684-46fc-aa32-4bad3c014d19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.593290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-047120e9-a684-46fc-aa32-4bad3c014d19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:23.785539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-047120e9-a684-46fc-aa32-4bad3c014d19 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 25245 microversion: 2.20 time: 0.209528 Apr 20 19:30:23.786496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 116/209] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:23 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 25245 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:23.881453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:23.881453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:23.889152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.889661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:23.890524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:23.891153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.149224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:24.158007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fde322bc-5df0-4777-9eec-c8d1bbb7150f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.286145 Apr 20 19:30:24.158808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 94/210] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:23 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:24.370975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:24.371819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:24.381349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.381869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.382706 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.383198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.454422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c79b8f77-3b4c-4c5b-99e3-e8879f7c692d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:24.455773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c79b8f77-3b4c-4c5b-99e3-e8879f7c692d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:24.463985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c79b8f77-3b4c-4c5b-99e3-e8879f7c692d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.464563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c79b8f77-3b4c-4c5b-99e3-e8879f7c692d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.465846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c79b8f77-3b4c-4c5b-99e3-e8879f7c692d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.466359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c79b8f77-3b4c-4c5b-99e3-e8879f7c692d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.602363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:24.617448 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e556f69-c443-45c8-88a6-5f14013ab5ae tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1508 microversion: 2.1 time: 0.250994 Apr 20 19:30:24.618067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 117/211] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:24 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:24.635186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7fb7095-f241-4f36-9ccb-2c7f80c01a29"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:24.636351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:24.643036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c79b8f77-3b4c-4c5b-99e3-e8879f7c692d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 17861 microversion: 2.1 time: 0.192380 Apr 20 19:30:24.647684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 95/212] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:24 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 17861 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:30:24.647846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.647846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.647846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.647846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.799082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b2a7bde0-d090-46d2-9556-b5240fa965fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:24.800443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b2a7bde0-d090-46d2-9556-b5240fa965fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:24.812188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b2a7bde0-d090-46d2-9556-b5240fa965fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.813036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b2a7bde0-d090-46d2-9556-b5240fa965fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.814060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b2a7bde0-d090-46d2-9556-b5240fa965fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.814580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b2a7bde0-d090-46d2-9556-b5240fa965fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.826431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] HTTP exception thrown: Invalid volume: volume f7fb7095-f241-4f36-9ccb-2c7f80c01a29 is already attached to instances: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 Apr 20 19:30:24.827137 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Returning 400 to user: Invalid volume: volume f7fb7095-f241-4f36-9ccb-2c7f80c01a29 is already attached to instances: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:30:24.828015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2cf6862f-9547-439f-bd03-2c32acfe43ea tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196768 Apr 20 19:30:24.828723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 118/213] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:30:24 2021] POST /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39/os-volume_attachments => generated 174 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 20 19:30:24.941768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:24.942715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:24.951016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.951524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.952369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:24.952901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:24.970731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b2a7bde0-d090-46d2-9556-b5240fa965fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 26031 microversion: 2.20 time: 0.176029 Apr 20 19:30:24.971648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 96/214] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:24 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 26031 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:30:25.153667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'services' on Instance uuid a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:30:25.177904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:25.178684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:25.187378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:25.188145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:25.189280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:25.189969 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:25.322239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5ff15e1-99ba-4e41-8a24-493cd7b3fb0e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "DELETE /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09/os-volume_attachments/f7fb7095-f241-4f36-9ccb-2c7f80c01a29" status: 202 len: 0 microversion: 2.1 time: 0.384393 Apr 20 19:30:25.323623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 119/215] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:30:24 2021] DELETE /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09/os-volume_attachments/f7fb7095-f241-4f36-9ccb-2c7f80c01a29 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:25.459795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:25.470273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f1e3588-00be-47f7-ae19-7af158053eff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.297302 Apr 20 19:30:25.471095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 97/216] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:25 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:25.657450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb320885-5363-4ae8-9a8f-843e1eae30b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:25.658674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb320885-5363-4ae8-9a8f-843e1eae30b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:25.671682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb320885-5363-4ae8-9a8f-843e1eae30b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:25.672387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb320885-5363-4ae8-9a8f-843e1eae30b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:25.673793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb320885-5363-4ae8-9a8f-843e1eae30b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:25.674480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb320885-5363-4ae8-9a8f-843e1eae30b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:25.868764 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb320885-5363-4ae8-9a8f-843e1eae30b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 18561 microversion: 2.1 time: 0.215134 Apr 20 19:30:25.869661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 120/217] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:25 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 18561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:25.985485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1920c1ea-3d43-46d1-915e-04b1e430eb2c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:25.987038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1920c1ea-3d43-46d1-915e-04b1e430eb2c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:25.995969 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1920c1ea-3d43-46d1-915e-04b1e430eb2c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:25.996520 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1920c1ea-3d43-46d1-915e-04b1e430eb2c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:25.997438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1920c1ea-3d43-46d1-915e-04b1e430eb2c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:25.997886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1920c1ea-3d43-46d1-915e-04b1e430eb2c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:26.326794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1920c1ea-3d43-46d1-915e-04b1e430eb2c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 26746 microversion: 2.20 time: 0.346210 Apr 20 19:30:26.327585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 98/218] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:25 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 26746 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:26.492202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:26.493606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:26.503552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:26.504071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:26.506050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:26.507407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:26.755963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:26.765083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9afd5f3b-da98-475f-9a6a-51aca7ba324b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.279238 Apr 20 19:30:26.765650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 121/219] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:26 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:26.880926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-73ee0682-a0c5-40c4-b570-0a2ecd529e8d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:26.882062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-73ee0682-a0c5-40c4-b570-0a2ecd529e8d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:26.890758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ee0682-a0c5-40c4-b570-0a2ecd529e8d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:26.891263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ee0682-a0c5-40c4-b570-0a2ecd529e8d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:26.892104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ee0682-a0c5-40c4-b570-0a2ecd529e8d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:26.892593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ee0682-a0c5-40c4-b570-0a2ecd529e8d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:27.054636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-73ee0682-a0c5-40c4-b570-0a2ecd529e8d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 20991 microversion: 2.1 time: 0.177917 Apr 20 19:30:27.058579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 99/220] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:26 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 20991 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:27.338386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-404d62be-9746-4b47-aec2-a4df7bf8de02 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:27.339421 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-404d62be-9746-4b47-aec2-a4df7bf8de02 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:27.347243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-404d62be-9746-4b47-aec2-a4df7bf8de02 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:27.347746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-404d62be-9746-4b47-aec2-a4df7bf8de02 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:27.348845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-404d62be-9746-4b47-aec2-a4df7bf8de02 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:27.349460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-404d62be-9746-4b47-aec2-a4df7bf8de02 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:27.537702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-404d62be-9746-4b47-aec2-a4df7bf8de02 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 27311 microversion: 2.20 time: 0.203084 Apr 20 19:30:27.542348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 122/221] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:27 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 27311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:27.786562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:27.787443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:27.796201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:27.796687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:27.797722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:27.798218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:27.992248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2091714712", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "94eaea9d-e39c-47da-9fde-443a214825c9"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:28.105868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] validate_networks() for [('94eaea9d-e39c-47da-9fde-443a214825c9', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:30:28.276616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:28.286825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60b5848f-9bb7-4009-a848-e5f28bc6df06 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.504641 Apr 20 19:30:28.301718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 100/222] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:27 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:28.301718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-481dfef8-ffa3-43c0-bdf4-354a6289e2aa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:28.301718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-481dfef8-ffa3-43c0-bdf4-354a6289e2aa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:28.302711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-481dfef8-ffa3-43c0-bdf4-354a6289e2aa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:28.303445 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-481dfef8-ffa3-43c0-bdf4-354a6289e2aa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:28.304888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-481dfef8-ffa3-43c0-bdf4-354a6289e2aa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:28.305592 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-481dfef8-ffa3-43c0-bdf4-354a6289e2aa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:28.549207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-481dfef8-ffa3-43c0-bdf4-354a6289e2aa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 22758 microversion: 2.1 time: 0.259512 Apr 20 19:30:28.549912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 101/223] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:28 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 22758 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:28.559628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ddd99b87-4d00-4a95-add4-69f942be0616 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:28.570867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ddd99b87-4d00-4a95-add4-69f942be0616 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:28.582988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddd99b87-4d00-4a95-add4-69f942be0616 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:28.583539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddd99b87-4d00-4a95-add4-69f942be0616 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:28.584333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddd99b87-4d00-4a95-add4-69f942be0616 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:28.584862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddd99b87-4d00-4a95-add4-69f942be0616 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:28.780919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ddd99b87-4d00-4a95-add4-69f942be0616 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 27650 microversion: 2.20 time: 0.229305 Apr 20 19:30:28.782288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 102/224] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:28 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 27650 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:29.215168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:30:29.215645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:30:29.216196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:30:29.216793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:30:29.217300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:30:29.227772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.228281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:29.229245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.229741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:29.249018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:30:29.253343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for user 6b2a4b1c9ccc4943bc354e2702f6db24 and project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:30:29.264698 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:30:29.267460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:30:29.310280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:29.311131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:29.319475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d64dded8-c304-4b7e-b8f0-4e2fc3fa21f6 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342384 Apr 20 19:30:29.320185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 123/225] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:30:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:30:29.320301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.320823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:29.321795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.322374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:29.330759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0a04a4a6-6919-4796-8235-2fb74b2ae40e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:29.331439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0a04a4a6-6919-4796-8235-2fb74b2ae40e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:29.451724 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0a04a4a6-6919-4796-8235-2fb74b2ae40e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:29.466108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0a04a4a6-6919-4796-8235-2fb74b2ae40e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1218 microversion: 2.1 time: 0.139333 Apr 20 19:30:29.467662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 124/226] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:29 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:29.561605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6a21e84c-8f93-40c6-a2dc-ccd2a87c61a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:29.562750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6a21e84c-8f93-40c6-a2dc-ccd2a87c61a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:29.572749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a21e84c-8f93-40c6-a2dc-ccd2a87c61a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.573270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a21e84c-8f93-40c6-a2dc-ccd2a87c61a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:29.574125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a21e84c-8f93-40c6-a2dc-ccd2a87c61a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.574606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a21e84c-8f93-40c6-a2dc-ccd2a87c61a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:29.619658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:29.637813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-be49c0f1-af47-42e9-a5f6-44166a06c798 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.332115 Apr 20 19:30:29.638668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 103/227] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:29 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:29.755735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6a21e84c-8f93-40c6-a2dc-ccd2a87c61a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 23795 microversion: 2.1 time: 0.198060 Apr 20 19:30:29.756934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 125/228] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:29 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 23795 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:29.798100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b20ebb08-e79b-4142-8e3c-1da4a85d2c1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:29.799862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b20ebb08-e79b-4142-8e3c-1da4a85d2c1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:29.811832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b20ebb08-e79b-4142-8e3c-1da4a85d2c1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.812404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b20ebb08-e79b-4142-8e3c-1da4a85d2c1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:29.813508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b20ebb08-e79b-4142-8e3c-1da4a85d2c1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:29.814245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b20ebb08-e79b-4142-8e3c-1da4a85d2c1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:30.486962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:30.487743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:30.497611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:30.498119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:30.499266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:30.499445 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:30.748327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:30.758903 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c4f3e98e-7a7f-41f2-a623-f8e417a70a33 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1222 microversion: 2.1 time: 0.276442 Apr 20 19:30:30.765160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 126/229] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:30 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1222 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:30.769547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:30.770286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:30.779255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:30.779762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:30.780863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:30.781370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:31.146474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:31.156101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3b31798a-4618-416a-a6ed-9c2eb90ea535 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.391689 Apr 20 19:30:31.156722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 127/230] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:30 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:31.164259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2db47cf5-4cc3-4134-9147-2150a373b06b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:31.165550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2db47cf5-4cc3-4134-9147-2150a373b06b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:31.173859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2db47cf5-4cc3-4134-9147-2150a373b06b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:31.174369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2db47cf5-4cc3-4134-9147-2150a373b06b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:31.175225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2db47cf5-4cc3-4134-9147-2150a373b06b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:31.175730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2db47cf5-4cc3-4134-9147-2150a373b06b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:32.913960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2db47cf5-4cc3-4134-9147-2150a373b06b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 25592 microversion: 2.1 time: 1.755541 Apr 20 19:30:32.919631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 128/231] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:31 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 25592 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:32.925239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:32.926055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:32.935079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:32.935510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:32.936365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:32.936888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:32.948349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b20ebb08-e79b-4142-8e3c-1da4a85d2c1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28190 microversion: 2.20 time: 3.157642 Apr 20 19:30:32.953121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 104/232] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:29 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28190 bytes in 3160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:32.958147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:32.959271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:32.968042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:32.968880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:32.970284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:32.973852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:33.153916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:33.164768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e5eb6f48-c93a-43f6-9642-90ea3b37cb4e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1214 microversion: 2.1 time: 0.247436 Apr 20 19:30:33.165399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 129/233] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:32 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:33.311178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:33.327317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-abb81d4f-3fd5-4b71-9727-d30bd612691a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.375798 Apr 20 19:30:33.328184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 105/234] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:32 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:33.938876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1bce8131-bd6c-4c3d-9dd7-2034cf7a0021 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:33.940069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1bce8131-bd6c-4c3d-9dd7-2034cf7a0021 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:33.970426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bce8131-bd6c-4c3d-9dd7-2034cf7a0021 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:33.970939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bce8131-bd6c-4c3d-9dd7-2034cf7a0021 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:33.972122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d7095203-a3d2-44e4-98ba-fc876de490f2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:33.972277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bce8131-bd6c-4c3d-9dd7-2034cf7a0021 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:33.972649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bce8131-bd6c-4c3d-9dd7-2034cf7a0021 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:33.975065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d7095203-a3d2-44e4-98ba-fc876de490f2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:34.006134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7095203-a3d2-44e4-98ba-fc876de490f2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.006920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7095203-a3d2-44e4-98ba-fc876de490f2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:34.007947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7095203-a3d2-44e4-98ba-fc876de490f2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.009309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d7095203-a3d2-44e4-98ba-fc876de490f2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:34.239418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d7095203-a3d2-44e4-98ba-fc876de490f2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28190 microversion: 2.20 time: 0.281445 Apr 20 19:30:34.240799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 106/235] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:33 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28190 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:30:34.258133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:34.259028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:34.300455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.301016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:34.301916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.302559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:34.613597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1bce8131-bd6c-4c3d-9dd7-2034cf7a0021 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 26486 microversion: 2.1 time: 0.689291 Apr 20 19:30:34.614808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 130/236] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:33 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 26486 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:34.622510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:34.632647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:34.639077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:34.641860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8b22f593-8838-40b7-9bce-3cee0ddf1b9c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1276 microversion: 2.1 time: 0.400104 Apr 20 19:30:34.651079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 107/237] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:34 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1276 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:34.657219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.657975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:34.659021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:34.659787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:34.958449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:34.975079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e9b6e191-95f7-4e35-b98f-28bd39afaf95 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.357198 Apr 20 19:30:34.975746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 131/238] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:34 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:35.260015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-97c16318-4095-4c82-907c-1c7560b4ed34 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:35.261235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-97c16318-4095-4c82-907c-1c7560b4ed34 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:35.277165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97c16318-4095-4c82-907c-1c7560b4ed34 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:35.280947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97c16318-4095-4c82-907c-1c7560b4ed34 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:35.281905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97c16318-4095-4c82-907c-1c7560b4ed34 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:35.288353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97c16318-4095-4c82-907c-1c7560b4ed34 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:35.491862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-97c16318-4095-4c82-907c-1c7560b4ed34 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28190 microversion: 2.20 time: 0.236829 Apr 20 19:30:35.493209 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 108/239] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:35 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28190 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:35.626772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-97392306-14e1-4353-881e-272dfd1ea92e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:35.627916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-97392306-14e1-4353-881e-272dfd1ea92e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:35.642864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97392306-14e1-4353-881e-272dfd1ea92e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:35.645749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97392306-14e1-4353-881e-272dfd1ea92e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:35.647278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97392306-14e1-4353-881e-272dfd1ea92e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:35.649300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97392306-14e1-4353-881e-272dfd1ea92e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:35.670311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:35.671688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:35.693205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:35.703768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:35.704925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:35.707874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:35.987338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-97392306-14e1-4353-881e-272dfd1ea92e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 27095 microversion: 2.1 time: 0.364749 Apr 20 19:30:35.988397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 132/240] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:35 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 27095 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:35.995281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:35.998988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:36.025938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:36.026393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:36.027280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:36.027782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:36.105584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:36.115750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-850f6b59-b447-4609-a7b2-c59bab8a5e41 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.449872 Apr 20 19:30:36.119325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 109/241] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:35 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:36.424761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:36.434353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-964d4c0c-33f8-46c8-baec-5eaee95e29fd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.444389 Apr 20 19:30:36.441045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 133/242] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:35 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:36.506246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dbb4daa4-6ad5-4a08-b6ca-13002ac5730f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:36.507316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dbb4daa4-6ad5-4a08-b6ca-13002ac5730f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:36.526668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbb4daa4-6ad5-4a08-b6ca-13002ac5730f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:36.527181 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbb4daa4-6ad5-4a08-b6ca-13002ac5730f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:36.528037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbb4daa4-6ad5-4a08-b6ca-13002ac5730f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:36.528535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dbb4daa4-6ad5-4a08-b6ca-13002ac5730f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:36.713633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dbb4daa4-6ad5-4a08-b6ca-13002ac5730f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28222 microversion: 2.20 time: 0.212807 Apr 20 19:30:36.715056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 110/243] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:36 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28222 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:36.894076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-b8f70072-07dd-4b62-9192-c52e3eaeb32a req-6d05a305-d652-4ee2-9edb-33ca4cb969ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e2a7a38-b159-42bc-8b4a-e137ac5ea64d", "tag": "bad69e7f-11c2-477d-a791-ffe7c816a6f4"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:36.895833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:36.895833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:30:36.905170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b8f70072-07dd-4b62-9192-c52e3eaeb32a req-6d05a305-d652-4ee2-9edb-33ca4cb969ca service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:36.905918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b8f70072-07dd-4b62-9192-c52e3eaeb32a req-6d05a305-d652-4ee2-9edb-33ca4cb969ca service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:36.924757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-b8f70072-07dd-4b62-9192-c52e3eaeb32a req-6d05a305-d652-4ee2-9edb-33ca4cb969ca service nova] Creating event network-changed:bad69e7f-11c2-477d-a791-ffe7c816a6f4 for instance 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d on hv-cinder-78726 Apr 20 19:30:36.930950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-b8f70072-07dd-4b62-9192-c52e3eaeb32a req-6d05a305-d652-4ee2-9edb-33ca4cb969ca service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041879 Apr 20 19:30:36.931691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 134/244] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:37.000884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9e5d2d2-4eff-4958-9331-4b5ed57efb8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:37.002652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9e5d2d2-4eff-4958-9331-4b5ed57efb8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:37.011129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e5d2d2-4eff-4958-9331-4b5ed57efb8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.011679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e5d2d2-4eff-4958-9331-4b5ed57efb8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.012852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e5d2d2-4eff-4958-9331-4b5ed57efb8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.013218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e5d2d2-4eff-4958-9331-4b5ed57efb8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.136942 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:37.137722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:37.152264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.153203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.154437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.155333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.211731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9e5d2d2-4eff-4958-9331-4b5ed57efb8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 27609 microversion: 2.1 time: 0.214519 Apr 20 19:30:37.212785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 111/245] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:36 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 27609 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:37.408303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:37.420430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ce748b88-bcbb-4a23-84df-0faf3b31b88f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.287907 Apr 20 19:30:37.430626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 135/246] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:37 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:37.454346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:37.455302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:37.469623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.470453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.471507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.472196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.705574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:37.715664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a102b9f1-4dbd-401d-92be-6d8612454052 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.265844 Apr 20 19:30:37.726196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 112/247] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:37 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:37.727624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-698e3541-bf5c-406d-8989-bb121c0683bb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:37.728658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-698e3541-bf5c-406d-8989-bb121c0683bb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:37.738110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-698e3541-bf5c-406d-8989-bb121c0683bb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.739759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-698e3541-bf5c-406d-8989-bb121c0683bb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.740880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-698e3541-bf5c-406d-8989-bb121c0683bb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:37.741614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-698e3541-bf5c-406d-8989-bb121c0683bb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:37.994504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-698e3541-bf5c-406d-8989-bb121c0683bb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28479 microversion: 2.20 time: 0.271048 Apr 20 19:30:37.999385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 136/248] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:37 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28479 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:38.225706 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d3846bf4-33aa-4af6-969c-e40730a812d8 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:38.227448 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d3846bf4-33aa-4af6-969c-e40730a812d8 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:38.240316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3846bf4-33aa-4af6-969c-e40730a812d8 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:38.240867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3846bf4-33aa-4af6-969c-e40730a812d8 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:38.241741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3846bf4-33aa-4af6-969c-e40730a812d8 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:38.242393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d3846bf4-33aa-4af6-969c-e40730a812d8 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:38.439328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:38.440651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:38.448411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d3846bf4-33aa-4af6-969c-e40730a812d8 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 27804 microversion: 2.1 time: 0.227921 Apr 20 19:30:38.449758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 113/249] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:38 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 27804 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:38.456778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:38.458091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:38.459603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:38.460314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:38.731411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:38.734854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:38.739509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:38.742461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8eef976c-f8c6-4b13-b0aa-e4ddfe566e7a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.307953 Apr 20 19:30:38.743084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 137/250] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:38 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:38.756878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:38.757310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:38.761386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:38.761905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:39.004744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:39.008298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9b573f72-135b-4353-9114-76205d8306a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:39.009472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9b573f72-135b-4353-9114-76205d8306a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:39.014606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bc2b0d73-f3ad-4904-ad37-0e10cda71af9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.284450 Apr 20 19:30:39.015451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 114/251] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:38 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:39.018537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b573f72-135b-4353-9114-76205d8306a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:39.020864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b573f72-135b-4353-9114-76205d8306a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:39.022003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b573f72-135b-4353-9114-76205d8306a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:39.022833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b573f72-135b-4353-9114-76205d8306a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:39.462147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7544c753-f66a-4573-9335-59bcb0f55db9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:39.463219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7544c753-f66a-4573-9335-59bcb0f55db9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:39.471013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7544c753-f66a-4573-9335-59bcb0f55db9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:39.471516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7544c753-f66a-4573-9335-59bcb0f55db9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:39.472349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7544c753-f66a-4573-9335-59bcb0f55db9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:39.472869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7544c753-f66a-4573-9335-59bcb0f55db9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:41.895767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9b573f72-135b-4353-9114-76205d8306a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28642 microversion: 2.20 time: 2.891692 Apr 20 19:30:41.900174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 138/252] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:39 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28642 bytes in 2894 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:41.902474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:41.903362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:41.913390 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:41.914033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:41.914998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:41.915603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:41.924928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7544c753-f66a-4573-9335-59bcb0f55db9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28143 microversion: 2.1 time: 2.466997 Apr 20 19:30:41.925496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 115/253] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:39 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28143 bytes in 2469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:41.932500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:41.933381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:41.943326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:41.943868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:41.944915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:41.945647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:42.277579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:42.289851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c992752f-bea0-4782-9823-ac1ca1ec5da5 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.361738 Apr 20 19:30:42.299747 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:42.300569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 116/254] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:41 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:42.304377 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5b847cae-4369-462f-9575-58b1468f9404 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.406287 Apr 20 19:30:42.305201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 139/255] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:41 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:42.917620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-828d77dd-e3c7-47f5-a03f-bcc8e89978a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:42.918762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-828d77dd-e3c7-47f5-a03f-bcc8e89978a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:42.928118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-828d77dd-e3c7-47f5-a03f-bcc8e89978a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:42.928615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-828d77dd-e3c7-47f5-a03f-bcc8e89978a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:42.929961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-828d77dd-e3c7-47f5-a03f-bcc8e89978a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:42.930822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-828d77dd-e3c7-47f5-a03f-bcc8e89978a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:42.947145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-59c6d130-7cee-4294-9aac-377ed0171672 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:42.948091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-59c6d130-7cee-4294-9aac-377ed0171672 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:42.966323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c6d130-7cee-4294-9aac-377ed0171672 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:42.966760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c6d130-7cee-4294-9aac-377ed0171672 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:42.970582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c6d130-7cee-4294-9aac-377ed0171672 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:42.971257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59c6d130-7cee-4294-9aac-377ed0171672 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:43.151906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-828d77dd-e3c7-47f5-a03f-bcc8e89978a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28642 microversion: 2.20 time: 0.247441 Apr 20 19:30:43.152595 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 117/256] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:42 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28642 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:30:43.170563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-59c6d130-7cee-4294-9aac-377ed0171672 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28143 microversion: 2.1 time: 0.227693 Apr 20 19:30:43.171441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 140/257] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:42 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28143 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:43.309039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:43.309905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:43.322166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:43.322942 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:43.324628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:43.325271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:43.325780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:43.326063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:43.338061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:43.338598 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:43.339480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:43.340166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:43.887812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:43.890819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:43.897459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-032dd6b0-6745-4c4a-a922-1811a9ba849f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.593042 Apr 20 19:30:43.898076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 118/258] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:43 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:43.900857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6ce8b746-8348-4c6e-8b0d-fb74ad23c2c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.581104 Apr 20 19:30:43.901685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 141/259] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:43 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:44.164963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5ff092cd-39f0-41fe-956e-74beefc5193e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:44.166514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5ff092cd-39f0-41fe-956e-74beefc5193e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:44.175008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ff092cd-39f0-41fe-956e-74beefc5193e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.175607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ff092cd-39f0-41fe-956e-74beefc5193e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.176475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ff092cd-39f0-41fe-956e-74beefc5193e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.177125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ff092cd-39f0-41fe-956e-74beefc5193e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.184504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-945c8820-5ace-493e-bdcf-290498028fb6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:44.185586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-945c8820-5ace-493e-bdcf-290498028fb6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:44.195085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-945c8820-5ace-493e-bdcf-290498028fb6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.195595 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-945c8820-5ace-493e-bdcf-290498028fb6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.196783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-945c8820-5ace-493e-bdcf-290498028fb6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.197281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-945c8820-5ace-493e-bdcf-290498028fb6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.328935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5ff092cd-39f0-41fe-956e-74beefc5193e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28642 microversion: 2.20 time: 0.168376 Apr 20 19:30:44.334089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 119/260] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:44 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28642 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:44.346379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-945c8820-5ace-493e-bdcf-290498028fb6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28143 microversion: 2.1 time: 0.167036 Apr 20 19:30:44.347849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 142/261] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:44 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28143 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:30:44.918734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:44.919604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:44.921395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:44.922351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:44.930432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.931132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.932270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.932822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.932969 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.933618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:44.934626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:44.935277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:45.275436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:45.281058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:45.284591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e8d8ee84-fe23-4f28-9cb2-6bb2d5939c3e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.370461 Apr 20 19:30:45.285895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 120/262] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:44 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:45.291332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f35386c4-a426-42bc-9b75-3264494f1631 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.375167 Apr 20 19:30:45.291960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 143/263] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:44 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:45.341948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5ef4252f-baa0-4704-be6f-1778dae547b7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:45.342989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5ef4252f-baa0-4704-be6f-1778dae547b7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:45.351695 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef4252f-baa0-4704-be6f-1778dae547b7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:45.352207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef4252f-baa0-4704-be6f-1778dae547b7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:45.353107 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef4252f-baa0-4704-be6f-1778dae547b7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:45.353601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef4252f-baa0-4704-be6f-1778dae547b7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:45.359649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-08ff332c-8885-4b9b-a514-62a551d5ea74 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:45.360696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-08ff332c-8885-4b9b-a514-62a551d5ea74 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:45.368701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08ff332c-8885-4b9b-a514-62a551d5ea74 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:45.369242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08ff332c-8885-4b9b-a514-62a551d5ea74 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:45.370086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08ff332c-8885-4b9b-a514-62a551d5ea74 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:45.370583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-08ff332c-8885-4b9b-a514-62a551d5ea74 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:45.525298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5ef4252f-baa0-4704-be6f-1778dae547b7 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28642 microversion: 2.20 time: 0.186927 Apr 20 19:30:45.526006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 121/264] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:45 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28642 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:45.545352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-08ff332c-8885-4b9b-a514-62a551d5ea74 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28143 microversion: 2.1 time: 0.189405 Apr 20 19:30:45.546250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 144/265] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:45 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28143 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:30:46.308555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:46.309346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:46.311163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:46.312266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:46.321368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.322106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.323080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.323286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.323797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.324116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.324740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.325540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.720873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:46.740542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88fe7516-6cac-477e-8cba-473e27058282 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.434113 Apr 20 19:30:46.746440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 145/266] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:46 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:46.751858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34c45221-861d-40a5-b79d-4df161f777c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:46.753723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34c45221-861d-40a5-b79d-4df161f777c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:46.761647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:46.764163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34c45221-861d-40a5-b79d-4df161f777c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.764941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34c45221-861d-40a5-b79d-4df161f777c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.766564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34c45221-861d-40a5-b79d-4df161f777c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.767838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34c45221-861d-40a5-b79d-4df161f777c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.774844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0b32da84-7430-4c86-ba57-3c06093b3e6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.474998 Apr 20 19:30:46.780753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 122/267] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:46 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:46.794400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c7e8fc5d-28e4-4217-9671-108751f3bb67 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:46.795723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c7e8fc5d-28e4-4217-9671-108751f3bb67 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:46.808019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7e8fc5d-28e4-4217-9671-108751f3bb67 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.808535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7e8fc5d-28e4-4217-9671-108751f3bb67 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:46.809420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7e8fc5d-28e4-4217-9671-108751f3bb67 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:46.810092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c7e8fc5d-28e4-4217-9671-108751f3bb67 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:47.005912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c7e8fc5d-28e4-4217-9671-108751f3bb67 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28168 microversion: 2.1 time: 0.225374 Apr 20 19:30:47.006956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 123/268] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:46 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28168 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:47.041400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34c45221-861d-40a5-b79d-4df161f777c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28642 microversion: 2.20 time: 0.293184 Apr 20 19:30:47.042271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 146/269] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:46 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28642 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:47.764896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:47.765773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:47.774924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:47.775434 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:47.776279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:47.776845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:47.796205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:47.797114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:47.805863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:47.806436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:47.807488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:47.808033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:48.173774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:48.176642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:48.181507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b82049d8-a443-4f86-b5ef-83b19653a708 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.389775 Apr 20 19:30:48.198574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 147/270] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:47 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:48.202962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7ff587cc-cc57-43cc-8e59-99a7aabc151c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.442951 Apr 20 19:30:48.203996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 124/271] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:47 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:48.212827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bc5b1e21-77e9-44ce-b182-69482807a673 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:48.214988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f6c14449-796a-4da4-9611-fee06c13d110 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:48.216089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f6c14449-796a-4da4-9611-fee06c13d110 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:48.218138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bc5b1e21-77e9-44ce-b182-69482807a673 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:48.224952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6c14449-796a-4da4-9611-fee06c13d110 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:48.225472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6c14449-796a-4da4-9611-fee06c13d110 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:48.226467 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6c14449-796a-4da4-9611-fee06c13d110 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:48.227148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f6c14449-796a-4da4-9611-fee06c13d110 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:48.233519 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc5b1e21-77e9-44ce-b182-69482807a673 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:48.237784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc5b1e21-77e9-44ce-b182-69482807a673 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:48.239327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc5b1e21-77e9-44ce-b182-69482807a673 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:48.241071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bc5b1e21-77e9-44ce-b182-69482807a673 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:48.399443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f6c14449-796a-4da4-9611-fee06c13d110 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28433 microversion: 2.1 time: 0.198554 Apr 20 19:30:48.405479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 148/272] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:48 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28433 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:48.413528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bc5b1e21-77e9-44ce-b182-69482807a673 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28642 microversion: 2.20 time: 0.204554 Apr 20 19:30:48.414879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 125/273] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:48 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28642 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:49.161840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-0ea4a0e6-0a8e-4ccc-972e-9828ef4c49a6 req-61537c2a-1010-49e6-83d4-d636dfb755c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a7a38-b159-42bc-8b4a-e137ac5ea64d", "name": "network-vif-plugged", "status": "completed", "tag": "bad69e7f-11c2-477d-a791-ffe7c816a6f4"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:49.163540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:30:49.163540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:30:49.173670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0ea4a0e6-0a8e-4ccc-972e-9828ef4c49a6 req-61537c2a-1010-49e6-83d4-d636dfb755c0 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.174149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0ea4a0e6-0a8e-4ccc-972e-9828ef4c49a6 req-61537c2a-1010-49e6-83d4-d636dfb755c0 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.203488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-0ea4a0e6-0a8e-4ccc-972e-9828ef4c49a6 req-61537c2a-1010-49e6-83d4-d636dfb755c0 service nova] Creating event network-vif-plugged:bad69e7f-11c2-477d-a791-ffe7c816a6f4 for instance 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d on hv-cinder-78726 Apr 20 19:30:49.206262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:49.208505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:49.209292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-0ea4a0e6-0a8e-4ccc-972e-9828ef4c49a6 req-61537c2a-1010-49e6-83d4-d636dfb755c0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052905 Apr 20 19:30:49.210019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 149/274] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:30:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:49.217800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.218671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.219686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.220471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.222519 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:49.224093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:49.232929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.233457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.234383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.235127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.683509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:49.696062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:49.698446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d0050335-3835-4cb2-a6fa-48aad260ba60 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.496243 Apr 20 19:30:49.699286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 126/275] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:49 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:49.705191 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7a0fc2ec-9bb8-4baf-a865-667bb0382e24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:49.707074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7a0fc2ec-9bb8-4baf-a865-667bb0382e24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:49.716841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e629caa2-5933-4ae5-8960-dac93ea0b390 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.499099 Apr 20 19:30:49.717493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 150/276] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:49 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:49.717977 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a0fc2ec-9bb8-4baf-a865-667bb0382e24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.718613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a0fc2ec-9bb8-4baf-a865-667bb0382e24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.719615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a0fc2ec-9bb8-4baf-a865-667bb0382e24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.720870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7a0fc2ec-9bb8-4baf-a865-667bb0382e24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.731481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0335be7f-bfbd-4989-8391-5e085694c20f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:49.735122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0335be7f-bfbd-4989-8391-5e085694c20f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:49.745895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0335be7f-bfbd-4989-8391-5e085694c20f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.748900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0335be7f-bfbd-4989-8391-5e085694c20f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:49.750045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0335be7f-bfbd-4989-8391-5e085694c20f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:49.750568 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0335be7f-bfbd-4989-8391-5e085694c20f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:52.188961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7a0fc2ec-9bb8-4baf-a865-667bb0382e24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 2.487854 Apr 20 19:30:52.190379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 127/277] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:49 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:52.197662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:52.198600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:52.213277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0335be7f-bfbd-4989-8391-5e085694c20f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 28642 microversion: 2.20 time: 2.494076 Apr 20 19:30:52.214144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 151/278] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:49 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 28642 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:52.222579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:52.234230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:52.234393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:52.234393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:52.234823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:52.235666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:52.246144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:52.246822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:52.247833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:52.248479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:52.589782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:52.596892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:52.599120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9d6a6b9e-cb1d-4c07-bdc1-222d0b0fb2e1 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.407324 Apr 20 19:30:52.599764 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 128/279] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:52 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:52.605953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a8c0fa57-303c-49c0-bd2e-307f6783afef tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.390234 Apr 20 19:30:52.606577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 152/280] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:52 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:53.202640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb800e30-a108-4278-835d-daf274100016 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:53.203692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb800e30-a108-4278-835d-daf274100016 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:53.212140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb800e30-a108-4278-835d-daf274100016 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.212651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb800e30-a108-4278-835d-daf274100016 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.213524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb800e30-a108-4278-835d-daf274100016 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.214021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb800e30-a108-4278-835d-daf274100016 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.226858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f76ed3dd-85d9-4e28-9099-3eb5e747e1d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:53.228058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f76ed3dd-85d9-4e28-9099-3eb5e747e1d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:53.235889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f76ed3dd-85d9-4e28-9099-3eb5e747e1d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.236394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f76ed3dd-85d9-4e28-9099-3eb5e747e1d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.237345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f76ed3dd-85d9-4e28-9099-3eb5e747e1d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.237835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f76ed3dd-85d9-4e28-9099-3eb5e747e1d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.396347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb800e30-a108-4278-835d-daf274100016 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 0.197128 Apr 20 19:30:53.398294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 129/281] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:53 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:53.471551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f76ed3dd-85d9-4e28-9099-3eb5e747e1d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 29080 microversion: 2.20 time: 0.249159 Apr 20 19:30:53.472259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 153/282] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:53 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 29080 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:30:53.617971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:53.618799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:53.624308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:53.625162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:53.627528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.628035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.628939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.629441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.634038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.634556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.635562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:53.636072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:53.953356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:53.963841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-041f9241-6c81-43e0-b9f6-dae7d161639d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.350530 Apr 20 19:30:53.964477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 130/283] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:53 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:53.965453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:53.974875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a1da4c1-3a81-4ddd-baa0-d37403fbaf8e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1318 microversion: 2.1 time: 0.355074 Apr 20 19:30:53.975566 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 154/284] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:53 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:54.414246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-948a44c7-ea40-459e-9241-89ca01eff358 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:54.415927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-948a44c7-ea40-459e-9241-89ca01eff358 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:54.424089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-948a44c7-ea40-459e-9241-89ca01eff358 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:54.424609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-948a44c7-ea40-459e-9241-89ca01eff358 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:54.425505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-948a44c7-ea40-459e-9241-89ca01eff358 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:54.426549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-948a44c7-ea40-459e-9241-89ca01eff358 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:54.484488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-43645cec-85e5-4d15-a691-6b8a4e3ebeec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:54.485648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-43645cec-85e5-4d15-a691-6b8a4e3ebeec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:54.503614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43645cec-85e5-4d15-a691-6b8a4e3ebeec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:54.505461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43645cec-85e5-4d15-a691-6b8a4e3ebeec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:54.506828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43645cec-85e5-4d15-a691-6b8a4e3ebeec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:54.507410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-43645cec-85e5-4d15-a691-6b8a4e3ebeec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:54.808104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-948a44c7-ea40-459e-9241-89ca01eff358 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 0.402452 Apr 20 19:30:54.808950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 131/285] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:54 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:54.870115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-43645cec-85e5-4d15-a691-6b8a4e3ebeec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 30205 microversion: 2.20 time: 0.381275 Apr 20 19:30:54.871601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 155/286] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:54 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 30205 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:30:54.994369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:54.995191 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:55.010715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:55.011523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:55.048929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.063342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.065446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:55.066821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.069362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:55.072811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:55.074111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.077261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:55.547336 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:55.558031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6aabcb4a-a51d-4ac7-b63e-86593b88899d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.579545 Apr 20 19:30:55.562863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 132/287] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:54 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:30:55.585764 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:55.595105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4a4b9ecb-3c69-4953-b0c0-0ffcad8b3bc2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1507 microversion: 2.1 time: 0.606436 Apr 20 19:30:55.596163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 156/288] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:54 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1507 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:55.822560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f1aaa327-0be8-4c85-9439-1d1b7fcd702a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:55.825235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f1aaa327-0be8-4c85-9439-1d1b7fcd702a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:55.838103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1aaa327-0be8-4c85-9439-1d1b7fcd702a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.838841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1aaa327-0be8-4c85-9439-1d1b7fcd702a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:55.839917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1aaa327-0be8-4c85-9439-1d1b7fcd702a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.840609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1aaa327-0be8-4c85-9439-1d1b7fcd702a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:55.883803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2d92fca9-e975-4485-b777-687fd10e2675 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:55.885349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2d92fca9-e975-4485-b777-687fd10e2675 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:55.901210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d92fca9-e975-4485-b777-687fd10e2675 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.901955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d92fca9-e975-4485-b777-687fd10e2675 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:55.916948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d92fca9-e975-4485-b777-687fd10e2675 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:55.925317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d92fca9-e975-4485-b777-687fd10e2675 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:56.089176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f1aaa327-0be8-4c85-9439-1d1b7fcd702a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 0.271041 Apr 20 19:30:56.090221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 133/289] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:55 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:56.181407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2d92fca9-e975-4485-b777-687fd10e2675 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 31725 microversion: 2.20 time: 0.301988 Apr 20 19:30:56.185849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 157/290] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:55 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 31725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:56.581335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:56.582744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:56.591504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:56.592022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:56.592888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:56.593552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:56.880920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:56.891240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f75e0a03-a72f-4157-9ede-790e211de146 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1521 microversion: 2.1 time: 0.314745 Apr 20 19:30:56.894781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 134/291] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:56 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:57.106757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4b6b12df-e639-42de-902e-e022eaf8476b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:57.107995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4b6b12df-e639-42de-902e-e022eaf8476b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:57.117581 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b6b12df-e639-42de-902e-e022eaf8476b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.118370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b6b12df-e639-42de-902e-e022eaf8476b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:57.119686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b6b12df-e639-42de-902e-e022eaf8476b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.120372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4b6b12df-e639-42de-902e-e022eaf8476b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:57.197036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f3396975-807f-40e5-961b-1c93549be56a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:57.197036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f3396975-807f-40e5-961b-1c93549be56a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:57.215496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3396975-807f-40e5-961b-1c93549be56a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.216482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3396975-807f-40e5-961b-1c93549be56a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:57.217580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3396975-807f-40e5-961b-1c93549be56a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.218788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3396975-807f-40e5-961b-1c93549be56a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:57.295829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4b6b12df-e639-42de-902e-e022eaf8476b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 0.193310 Apr 20 19:30:57.296893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 158/292] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:57 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:57.306324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-39f9d39d-b405-40dd-a412-dd9a8f8067f4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae96c836-dce2-4986-9540-adb0afab308a"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:57.308624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-39f9d39d-b405-40dd-a412-dd9a8f8067f4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:57.318802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39f9d39d-b405-40dd-a412-dd9a8f8067f4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.319318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39f9d39d-b405-40dd-a412-dd9a8f8067f4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:57.320268 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39f9d39d-b405-40dd-a412-dd9a8f8067f4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.320808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39f9d39d-b405-40dd-a412-dd9a8f8067f4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:57.412723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f3396975-807f-40e5-961b-1c93549be56a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 32473 microversion: 2.20 time: 0.222249 Apr 20 19:30:57.413685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 135/293] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:57 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 32473 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:30:57.827169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-39f9d39d-b405-40dd-a412-dd9a8f8067f4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528078 Apr 20 19:30:57.827985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 159/294] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:30:57 2021] POST /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:30:57.915705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:57.916575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:57.937885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.938621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:57.939716 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:57.940416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:58.192893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:58.203369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d41aa4b4-743c-4a98-b9fa-7a66195044bb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1501 microversion: 2.1 time: 0.295019 Apr 20 19:30:58.204024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 136/295] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:57 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1501 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:58.221206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:30:58.222002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:58.231768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:58.232288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:58.233239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:58.233742 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:58.311754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-008e5b9a-8201-4886-928a-fe38303a3b9f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:58.314837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-008e5b9a-8201-4886-928a-fe38303a3b9f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:58.338225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008e5b9a-8201-4886-928a-fe38303a3b9f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:58.338976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008e5b9a-8201-4886-928a-fe38303a3b9f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:58.340003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008e5b9a-8201-4886-928a-fe38303a3b9f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:58.340650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008e5b9a-8201-4886-928a-fe38303a3b9f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:58.528748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:30:58.540466 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-008e5b9a-8201-4886-928a-fe38303a3b9f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 0.236062 Apr 20 19:30:58.540637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8028a6d5-bddc-4068-bfe2-5a75c0bb2c91 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1515 microversion: 2.1 time: 0.323737 Apr 20 19:30:58.542252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 137/297] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:58 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:30:58.543096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 160/297] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:30:58 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:30:58.548699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e7283d87-06cd-4bff-967d-5ac7f96aa62b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:58.550043 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e7283d87-06cd-4bff-967d-5ac7f96aa62b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:58.559575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7283d87-06cd-4bff-967d-5ac7f96aa62b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:58.560181 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7283d87-06cd-4bff-967d-5ac7f96aa62b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:58.560965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7283d87-06cd-4bff-967d-5ac7f96aa62b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:58.561461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7283d87-06cd-4bff-967d-5ac7f96aa62b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:59.559706 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5194bdd8-5bd5-4a7a-ad09-387482f8a2eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:30:59.562786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5194bdd8-5bd5-4a7a-ad09-387482f8a2eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:30:59.571793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5194bdd8-5bd5-4a7a-ad09-387482f8a2eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:59.572300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5194bdd8-5bd5-4a7a-ad09-387482f8a2eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:30:59.573175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5194bdd8-5bd5-4a7a-ad09-387482f8a2eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:30:59.573669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5194bdd8-5bd5-4a7a-ad09-387482f8a2eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:01.611957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e7283d87-06cd-4bff-967d-5ac7f96aa62b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 35411 microversion: 2.20 time: 3.067540 Apr 20 19:31:01.612978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 138/298] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:30:58 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 35411 bytes in 3070 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:01.651823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5194bdd8-5bd5-4a7a-ad09-387482f8a2eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 2.101503 Apr 20 19:31:01.652771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 161/299] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:30:59 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:02.624894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b97f023c-cfef-4053-beac-d6cac93ca703 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:02.626279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b97f023c-cfef-4053-beac-d6cac93ca703 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:02.636078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b97f023c-cfef-4053-beac-d6cac93ca703 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:02.636589 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b97f023c-cfef-4053-beac-d6cac93ca703 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:02.637491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b97f023c-cfef-4053-beac-d6cac93ca703 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:02.637989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b97f023c-cfef-4053-beac-d6cac93ca703 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:02.665838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a38f4620-e41b-457b-b3bb-ce0d6b0531e1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:02.667196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a38f4620-e41b-457b-b3bb-ce0d6b0531e1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:02.676042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38f4620-e41b-457b-b3bb-ce0d6b0531e1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:02.676851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38f4620-e41b-457b-b3bb-ce0d6b0531e1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:02.678035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38f4620-e41b-457b-b3bb-ce0d6b0531e1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:02.678532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38f4620-e41b-457b-b3bb-ce0d6b0531e1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:05.308282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b97f023c-cfef-4053-beac-d6cac93ca703 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 37726 microversion: 2.20 time: 2.687651 Apr 20 19:31:05.310267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 139/300] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:31:02 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 37726 bytes in 2690 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:05.364495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a38f4620-e41b-457b-b3bb-ce0d6b0531e1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 28601 microversion: 2.1 time: 2.702288 Apr 20 19:31:05.368777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 162/301] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:02 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 28601 bytes in 2706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:31:06.322147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ce26b0d4-12c9-41fa-82e6-cde9bf8b950a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:06.323305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ce26b0d4-12c9-41fa-82e6-cde9bf8b950a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:06.332582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce26b0d4-12c9-41fa-82e6-cde9bf8b950a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:06.333666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce26b0d4-12c9-41fa-82e6-cde9bf8b950a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:06.334535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce26b0d4-12c9-41fa-82e6-cde9bf8b950a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:06.335037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce26b0d4-12c9-41fa-82e6-cde9bf8b950a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:06.377692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ee20ee27-b8f6-4149-a603-b899be9f9de9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:06.379302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ee20ee27-b8f6-4149-a603-b899be9f9de9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:06.387833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee20ee27-b8f6-4149-a603-b899be9f9de9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:06.388333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee20ee27-b8f6-4149-a603-b899be9f9de9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:06.389364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee20ee27-b8f6-4149-a603-b899be9f9de9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:06.389869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee20ee27-b8f6-4149-a603-b899be9f9de9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:06.527558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ce26b0d4-12c9-41fa-82e6-cde9bf8b950a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 38176 microversion: 2.20 time: 0.209753 Apr 20 19:31:06.528254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 140/302] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:31:06 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 38176 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:06.588641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ee20ee27-b8f6-4149-a603-b899be9f9de9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 29017 microversion: 2.1 time: 0.215383 Apr 20 19:31:06.589387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 163/303] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:06 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 29017 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:07.354862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:07.356052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:07.365610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.366127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.367109 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.367613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.437270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lazy-loading 'flavor' on Instance uuid c9c99e67-a6e2-4f90-bb81-d4e3f368f1de {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:31:07.541194 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-978e8e61-1375-45af-96c0-03e9b208668d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:07.542353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-978e8e61-1375-45af-96c0-03e9b208668d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:07.552202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-978e8e61-1375-45af-96c0-03e9b208668d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.552202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-978e8e61-1375-45af-96c0-03e9b208668d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.553013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-978e8e61-1375-45af-96c0-03e9b208668d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.553515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-978e8e61-1375-45af-96c0-03e9b208668d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.608231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5fddeba0-42e8-4468-9d3c-6275ce7c69ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action" status: 200 len: 32 microversion: 2.1 time: 0.258116 Apr 20 19:31:07.609150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 141/304] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:07 2021] POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:31:07.615202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-18b56c50-e97f-4ed3-bc3f-5396785693ff tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:07.616658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-18b56c50-e97f-4ed3-bc3f-5396785693ff tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:07.639413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18b56c50-e97f-4ed3-bc3f-5396785693ff tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.640069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18b56c50-e97f-4ed3-bc3f-5396785693ff tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.641167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18b56c50-e97f-4ed3-bc3f-5396785693ff tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.641797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-18b56c50-e97f-4ed3-bc3f-5396785693ff tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.773748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-978e8e61-1375-45af-96c0-03e9b208668d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 200 len: 38318 microversion: 2.20 time: 0.237058 Apr 20 19:31:07.779611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 164/305] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:31:07 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 38318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:07.780068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:07.780875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:07.789669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.790249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.791011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.791506 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.846954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-18b56c50-e97f-4ed3-bc3f-5396785693ff tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 30341 microversion: 2.1 time: 0.236085 Apr 20 19:31:07.848139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 142/306] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:07 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 30341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:07.854072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-577dfa4c-6b1f-4887-82f7-746e58df0151 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:07.854678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-577dfa4c-6b1f-4887-82f7-746e58df0151 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:07.864589 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-577dfa4c-6b1f-4887-82f7-746e58df0151 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.865313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-577dfa4c-6b1f-4887-82f7-746e58df0151 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.867753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-577dfa4c-6b1f-4887-82f7-746e58df0151 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:07.868272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-577dfa4c-6b1f-4887-82f7-746e58df0151 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:07.941077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-577dfa4c-6b1f-4887-82f7-746e58df0151 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/ips" status: 200 len: 151 microversion: 2.20 time: 0.090614 Apr 20 19:31:07.942528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 143/307] 10.222.0.38 () {60 vars in 1279 bytes} [Tue Apr 20 19:31:07 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:08.038838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:08.048303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b303fe6-76f1-4e69-b7e6-5d32dcc00db6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.272427 Apr 20 19:31:08.060537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 165/308] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:07 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:08.859565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ff68599c-66d9-4bbd-8ab8-1fee762269ae tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:08.860698 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ff68599c-66d9-4bbd-8ab8-1fee762269ae tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:08.869887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff68599c-66d9-4bbd-8ab8-1fee762269ae tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:08.870467 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff68599c-66d9-4bbd-8ab8-1fee762269ae tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:08.871379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff68599c-66d9-4bbd-8ab8-1fee762269ae tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:08.871876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff68599c-66d9-4bbd-8ab8-1fee762269ae tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:09.037443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ff68599c-66d9-4bbd-8ab8-1fee762269ae tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 31802 microversion: 2.1 time: 0.182009 Apr 20 19:31:09.038418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 144/309] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:08 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 31802 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:09.067915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:09.068734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:09.077248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:09.077859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:09.078752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:09.079314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:09.305680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:09.314671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-460aaf49-2cc8-40b3-9291-4497f12d942e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.251048 Apr 20 19:31:09.315228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 166/310] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:09 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:10.051761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-47656e61-2e5c-4b95-b9e4-b8859c252a27 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:10.052910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-47656e61-2e5c-4b95-b9e4-b8859c252a27 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:10.061669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47656e61-2e5c-4b95-b9e4-b8859c252a27 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:10.062194 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47656e61-2e5c-4b95-b9e4-b8859c252a27 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:10.063041 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47656e61-2e5c-4b95-b9e4-b8859c252a27 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:10.063540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47656e61-2e5c-4b95-b9e4-b8859c252a27 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:10.246357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-47656e61-2e5c-4b95-b9e4-b8859c252a27 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 32714 microversion: 2.1 time: 0.199915 Apr 20 19:31:10.247072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 145/311] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:10 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 32714 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:10.334350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:10.334988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:10.342876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:10.343393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:10.344242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:10.344769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:10.560683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:10.570091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7b251ab0-4412-4fa2-beba-384a34ef8deb tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.240706 Apr 20 19:31:10.570717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 167/312] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:10 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:10.911596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:10.912606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:10.922323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:10.922924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:10.923932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:10.924533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:10.995398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lazy-loading 'flavor' on Instance uuid 75ca897f-86b0-4162-a72d-2a399eef0f34 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:31:11.259233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4200785d-091e-4c8b-9ffe-3f1269b48054 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:11.260734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4200785d-091e-4c8b-9ffe-3f1269b48054 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:11.269267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4200785d-091e-4c8b-9ffe-3f1269b48054 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:11.269789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4200785d-091e-4c8b-9ffe-3f1269b48054 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:11.270623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4200785d-091e-4c8b-9ffe-3f1269b48054 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:11.271115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4200785d-091e-4c8b-9ffe-3f1269b48054 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:11.363518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b3297992-d3f2-47a6-8aa6-b1896c63218e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 202 len: 0 microversion: 2.20 time: 0.457035 Apr 20 19:31:11.365132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 146/313] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:31:10 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:31:11.374234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:11.375015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:11.384123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:11.384637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:11.385539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:11.386045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:11.477762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4200785d-091e-4c8b-9ffe-3f1269b48054 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 33149 microversion: 2.1 time: 0.218341 Apr 20 19:31:11.482754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 168/314] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:11 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 33149 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:31:11.600856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:11.601662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:11.614766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:11.615556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:11.616597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:11.617677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:11.661500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:11.681080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:11.683196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:11.684513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-687d8e60-e718-41ff-9840-dcef345420a3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.314747 Apr 20 19:31:11.688768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 147/315] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:11 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:31:11.883983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:11.906559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e6c3be0b-c9c3-4379-b9b0-085b9fdd99f3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.318062 Apr 20 19:31:11.909413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 169/316] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:11 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:12.490476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8613ccc2-f171-45d6-8eca-a8e3a9c499fb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:12.491662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8613ccc2-f171-45d6-8eca-a8e3a9c499fb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:12.499864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8613ccc2-f171-45d6-8eca-a8e3a9c499fb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:12.500368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8613ccc2-f171-45d6-8eca-a8e3a9c499fb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:12.501254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8613ccc2-f171-45d6-8eca-a8e3a9c499fb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:12.501721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8613ccc2-f171-45d6-8eca-a8e3a9c499fb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:12.687383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8613ccc2-f171-45d6-8eca-a8e3a9c499fb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 33523 microversion: 2.1 time: 0.201028 Apr 20 19:31:12.688198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 148/317] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:12 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 33523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:12.708938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:12.709598 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:12.719697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:12.720215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:12.721147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:12.721648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:12.928546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:12.929879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:12.939571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:12.940130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:12.941753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:12.942410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:13.233486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:13.249804 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:13.251724 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:13.253115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-333d264d-0f5d-4c85-bcce-20f13527a139 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.549434 Apr 20 19:31:13.254869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 170/318] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:12 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:13.308940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:13.324207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2aede51c-60ba-4cf3-bc45-a49097353c16 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.400800 Apr 20 19:31:13.328756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 149/319] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:12 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:13.703911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ef22ab5-3dd0-4b8f-8067-a74f49be74e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:13.705194 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4ef22ab5-3dd0-4b8f-8067-a74f49be74e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:13.714472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ef22ab5-3dd0-4b8f-8067-a74f49be74e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:13.715240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ef22ab5-3dd0-4b8f-8067-a74f49be74e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:13.716308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ef22ab5-3dd0-4b8f-8067-a74f49be74e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:13.717035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ef22ab5-3dd0-4b8f-8067-a74f49be74e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:13.885513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ef22ab5-3dd0-4b8f-8067-a74f49be74e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 34008 microversion: 2.1 time: 0.185120 Apr 20 19:31:13.886533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 171/320] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:13 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 34008 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:14.099360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae96c836-dce2-4986-9540-adb0afab308a"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:14.100561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:14.108665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.109739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.110603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.111102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.276966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:14.277629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:14.290552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.291739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.292878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.293578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.336581 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] HTTP exception thrown: Invalid volume: volume ae96c836-dce2-4986-9540-adb0afab308a is already attached to instances: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d Apr 20 19:31:14.337357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Returning 400 to user: Invalid volume: volume ae96c836-dce2-4986-9540-adb0afab308a is already attached to instances: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:31:14.338715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5cc98d1a-312b-47ec-bceb-93e50c11ee97 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.244133 Apr 20 19:31:14.339811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 150/321] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:31:14 2021] POST /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d/os-volume_attachments => generated 174 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:31:14.345565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:14.346503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:14.359276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.360246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.364168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.365891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.654214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:14.666438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:14.668130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:14.669419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b62c0602-d21f-468f-bae9-4cc30f634dec tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.398743 Apr 20 19:31:14.670598 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 172/322] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:14 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:14.676465 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:14.677289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:14.685446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.686100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.690354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.690354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.784733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:14.793897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-390e5bd1-f327-4532-838f-1174ddd32e02 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.452561 Apr 20 19:31:14.799853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 151/323] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:14 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:14.888458 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'services' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:31:14.897920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83ba2714-b386-4b7c-8ea9-b4e8caf1f00b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:14.899066 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83ba2714-b386-4b7c-8ea9-b4e8caf1f00b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:14.907201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83ba2714-b386-4b7c-8ea9-b4e8caf1f00b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.907928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83ba2714-b386-4b7c-8ea9-b4e8caf1f00b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:14.909865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83ba2714-b386-4b7c-8ea9-b4e8caf1f00b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:14.910792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83ba2714-b386-4b7c-8ea9-b4e8caf1f00b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:15.048171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb06e629-8a49-40be-b809-7ef3869cb51f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "DELETE /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d/os-volume_attachments/ae96c836-dce2-4986-9540-adb0afab308a" status: 202 len: 0 microversion: 2.1 time: 0.376058 Apr 20 19:31:15.048954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 173/324] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:31:14 2021] DELETE /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d/os-volume_attachments/ae96c836-dce2-4986-9540-adb0afab308a => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:15.073307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83ba2714-b386-4b7c-8ea9-b4e8caf1f00b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 34804 microversion: 2.1 time: 0.179014 Apr 20 19:31:15.074289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 152/325] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:14 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 34804 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:31:15.692462 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:15.693502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:15.701993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:15.702514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:15.704375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:15.704913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:15.818990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:15.820624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:15.831161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:15.832296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:15.833649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:15.834338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:15.937633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:15.950190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:15.951875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:15.953321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-45f70ed7-8707-4adf-87f3-1a15905752b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.266536 Apr 20 19:31:15.953919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 174/326] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:15 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:16.085811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c107c443-7007-4364-a8a8-7baa58085a7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:16.086940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c107c443-7007-4364-a8a8-7baa58085a7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:16.103181 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c107c443-7007-4364-a8a8-7baa58085a7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:16.103982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c107c443-7007-4364-a8a8-7baa58085a7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:16.105261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c107c443-7007-4364-a8a8-7baa58085a7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:16.105912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c107c443-7007-4364-a8a8-7baa58085a7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:16.217429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:16.226999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-22b1e7d3-e7b1-4ff6-bf4c-9c491059b12a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.412977 Apr 20 19:31:16.227714 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 153/327] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:15 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:16.289516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c107c443-7007-4364-a8a8-7baa58085a7a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 35485 microversion: 2.1 time: 0.207951 Apr 20 19:31:16.290437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 175/328] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:16 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 35485 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:31:16.974005 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:16.974683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:16.985702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:16.986418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:16.988175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:16.988649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:17.225358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:17.236000 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:17.237952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:17.239533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-192eb279-bf79-4709-aed4-2769bc47e734 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.269989 Apr 20 19:31:17.246629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:17.247663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:17.253639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 154/329] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:16 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:17.257686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:17.258437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:17.259489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:17.260175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:17.302623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8b33edc0-92a9-4e18-8219-3464e3f58440 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:17.304029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8b33edc0-92a9-4e18-8219-3464e3f58440 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:17.317965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b33edc0-92a9-4e18-8219-3464e3f58440 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:17.321269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b33edc0-92a9-4e18-8219-3464e3f58440 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:17.322328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b33edc0-92a9-4e18-8219-3464e3f58440 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:17.323018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8b33edc0-92a9-4e18-8219-3464e3f58440 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:17.487056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8b33edc0-92a9-4e18-8219-3464e3f58440 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 36161 microversion: 2.1 time: 0.188306 Apr 20 19:31:17.489089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 155/330] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:17 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 36161 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:17.545251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:17.556903 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1eacc316-86aa-4b00-b269-348a03552d4c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.314701 Apr 20 19:31:17.557772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 176/331] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:17 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:17.666370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1043226247", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "94eaea9d-e39c-47da-9fde-443a214825c9"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:17.750357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] validate_networks() for [('94eaea9d-e39c-47da-9fde-443a214825c9', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:31:18.259584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:18.260379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:18.269679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.270188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.271024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.271535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.350781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:31:18.351259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:31:18.351806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:31:18.352269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:31:18.352755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:31:18.361725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.362312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.363543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.364033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.387858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:31:18.392220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Getting quotas for user 6b2a4b1c9ccc4943bc354e2702f6db24 and project 360d38b62ef6436f887341a67ecd69b5. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:31:18.405168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:31:18.407927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:31:18.463115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1631a588-288f-4ed6-a9c8-22e9b47be95d tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802834 Apr 20 19:31:18.464162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 156/332] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:31:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:31:18.475606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c57871d-57cd-4094-b98b-afb44c515e58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:18.476432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c57871d-57cd-4094-b98b-afb44c515e58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:18.499273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:18.516560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:18.518283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:18.520135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f4c5dbfd-fc45-4a97-b1cd-89f71107a005 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.264948 Apr 20 19:31:18.520795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 177/333] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:18 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:31:18.532294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7fa4ee24-2804-4b72-9ae2-e48ca406ad55 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:18.533991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7fa4ee24-2804-4b72-9ae2-e48ca406ad55 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:18.542649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fa4ee24-2804-4b72-9ae2-e48ca406ad55 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.543376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fa4ee24-2804-4b72-9ae2-e48ca406ad55 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.544235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fa4ee24-2804-4b72-9ae2-e48ca406ad55 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.544802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7fa4ee24-2804-4b72-9ae2-e48ca406ad55 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.560535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c57871d-57cd-4094-b98b-afb44c515e58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:18.569668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c57871d-57cd-4094-b98b-afb44c515e58 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1218 microversion: 2.1 time: 0.098431 Apr 20 19:31:18.570187 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 157/334] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:18 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:18.578235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:18.579827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:18.589530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.590048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.591087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:18.591595 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:18.721801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7fa4ee24-2804-4b72-9ae2-e48ca406ad55 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 36807 microversion: 2.1 time: 0.199336 Apr 20 19:31:18.724066 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 178/335] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:18 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 36807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:18.845289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:18.855313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9db0952-6b0e-463d-8e4a-41a18c8bf822 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.283909 Apr 20 19:31:18.855987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 158/336] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:18 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:18.932939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1938973715", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "9ab6c281-68b5-4ebd-9d5b-ff1c3d42a6de"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:19.009331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] validate_networks() for [('9ab6c281-68b5-4ebd-9d5b-ff1c3d42a6de', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:31:19.539845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:19.540501 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:19.549112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.549771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.550843 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.551502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.591662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:31:19.592297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:31:19.592901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:31:19.593376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:31:19.594015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:31:19.604831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.605570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.606481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.606982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.627668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Getting quotas for project a57e6ed91f174567963cdeb0df5ab371. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:31:19.632654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Getting quotas for user ff879400ac734b22998db346bfc74242 and project a57e6ed91f174567963cdeb0df5ab371. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:31:19.648406 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:31:19.651218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:31:19.704590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-36f673a1-fb86-445f-b258-e0889b5f65c1 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776087 Apr 20 19:31:19.705629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 179/337] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:31:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:31:19.717931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:19.718610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:19.728664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.728664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.728664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.729105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.794140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:19.827331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:19.829310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:19.833985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-106cf315-acf7-4940-b369-0f4abd8cac1d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.298266 Apr 20 19:31:19.835095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 159/338] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:19 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:19.843168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d5be9189-1f81-41ab-8e9a-801242074f2b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:19.846482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d5be9189-1f81-41ab-8e9a-801242074f2b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:19.860820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:19.871259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2e64e678-de8b-46ee-a0f0-7aa8d0da9c87 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1278 microversion: 2.1 time: 0.158247 Apr 20 19:31:19.872058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 180/339] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:19 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:19.877875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cd116741-4481-4f6e-87aa-910e244a2664 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:19.879769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cd116741-4481-4f6e-87aa-910e244a2664 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:19.888036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd116741-4481-4f6e-87aa-910e244a2664 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.888891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd116741-4481-4f6e-87aa-910e244a2664 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.889936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd116741-4481-4f6e-87aa-910e244a2664 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:19.890620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd116741-4481-4f6e-87aa-910e244a2664 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:19.966673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d5be9189-1f81-41ab-8e9a-801242074f2b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:19.979492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d5be9189-1f81-41ab-8e9a-801242074f2b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1219 microversion: 2.1 time: 0.139516 Apr 20 19:31:19.979492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 160/340] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:19 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:19.989692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:19.990541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:20.000380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:20.000915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:20.001776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:20.002271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:20.092890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cd116741-4481-4f6e-87aa-910e244a2664 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 37872 microversion: 2.1 time: 0.219080 Apr 20 19:31:20.093765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 181/341] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:19 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 37872 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:20.255404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:20.264542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9df2687c-4930-4ea6-87f7-8d69067f7f31 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.286936 Apr 20 19:31:20.265344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 161/342] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:19 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:20.855184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:20.856617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:20.865959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:20.866467 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:20.867317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:20.867807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:20.896801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:20.897554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:20.908082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:20.908991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:20.910276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:20.910763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:21.429808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:21.451270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:21.453188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:21.454382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:21.454888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-41d06445-8828-4720-934e-db64bb5201ef tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.604386 Apr 20 19:31:21.455837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 182/343] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:20 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:21.465189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4675869f-671c-4b36-9809-f4a8b2e82079 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.574289 Apr 20 19:31:21.466095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:21.466815 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 162/344] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:20 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:21.478155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:21.482477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f308286c-4fee-4ec7-bfd7-dd9e58cac3a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:21.498450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f308286c-4fee-4ec7-bfd7-dd9e58cac3a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:21.502024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:21.502548 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:21.503672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:21.504180 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:21.519748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f308286c-4fee-4ec7-bfd7-dd9e58cac3a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:21.523428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f308286c-4fee-4ec7-bfd7-dd9e58cac3a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:21.525866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f308286c-4fee-4ec7-bfd7-dd9e58cac3a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:21.528538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f308286c-4fee-4ec7-bfd7-dd9e58cac3a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:21.742539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:21.753841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f2b8a8c-29a1-4791-ad65-abd90c0ba13e tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1279 microversion: 2.1 time: 0.295569 Apr 20 19:31:21.760987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 183/345] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:21 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:21.778297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:21.779002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:21.795948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f308286c-4fee-4ec7-bfd7-dd9e58cac3a9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 38091 microversion: 2.1 time: 0.324830 Apr 20 19:31:21.800511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 163/346] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:21 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 38091 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:21.818542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:21.819066 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:21.819943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:21.820442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:22.339456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:22.367125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4322a2a8-5631-45a4-900c-d0a38837983c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.611002 Apr 20 19:31:22.377022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 184/347] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:21 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:22.475827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:22.476535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:22.489573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:22.490258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:22.497332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:22.498050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:22.499131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:22.499606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:22.503355 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:22.504141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:22.505156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:22.505638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.220075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:23.231320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:23.233192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:23.234978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0f8b696-e21b-4fbe-a7fd-cf25e33961d5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.764355 Apr 20 19:31:23.243430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 164/348] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:22 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:23.247653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:23.248452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:23.262826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:23.266691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.271472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.272383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.272975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.277981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-795c55f0-a6ce-4973-a31c-938a70c6058f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.793218 Apr 20 19:31:23.286656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 185/349] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:22 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:23.296373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-290d4152-7f59-4e95-ae04-14a96ca64ea4 req-09496f46-c7b8-468d-a625-e5b0a97f8680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8baa13b-2f85-4be8-80b7-c17f894b63c3", "tag": "7308268c-7f90-4bfd-ac50-da6e465d6946"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:23.298435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:23.298435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:23.320124 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-290d4152-7f59-4e95-ae04-14a96ca64ea4 req-09496f46-c7b8-468d-a625-e5b0a97f8680 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.322773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-290d4152-7f59-4e95-ae04-14a96ca64ea4 req-09496f46-c7b8-468d-a625-e5b0a97f8680 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.376965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-290d4152-7f59-4e95-ae04-14a96ca64ea4 req-09496f46-c7b8-468d-a625-e5b0a97f8680 service nova] Creating event network-changed:7308268c-7f90-4bfd-ac50-da6e465d6946 for instance c8baa13b-2f85-4be8-80b7-c17f894b63c3 on hv-cinder-78726 Apr 20 19:31:23.397652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-290d4152-7f59-4e95-ae04-14a96ca64ea4 req-09496f46-c7b8-468d-a625-e5b0a97f8680 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108938 Apr 20 19:31:23.398567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 186/350] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:23.413486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f790b6b0-6f84-4eb1-b0ca-0c17266cf469 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:23.414794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f790b6b0-6f84-4eb1-b0ca-0c17266cf469 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:23.425067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f790b6b0-6f84-4eb1-b0ca-0c17266cf469 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.425578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f790b6b0-6f84-4eb1-b0ca-0c17266cf469 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.430502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f790b6b0-6f84-4eb1-b0ca-0c17266cf469 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.431026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f790b6b0-6f84-4eb1-b0ca-0c17266cf469 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.673670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f790b6b0-6f84-4eb1-b0ca-0c17266cf469 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 200 len: 38211 microversion: 2.1 time: 0.271470 Apr 20 19:31:23.674674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 187/351] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:23 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 38211 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:31:23.681601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:23.683521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:23.695412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.696482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.698004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.698839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.735352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:23.754254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-684aab29-d7cf-41f0-b3df-d0f239160515 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.516759 Apr 20 19:31:23.757619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 165/352] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:23 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:23.772174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-41c14040-ecdc-40f7-8d28-c415f88436c5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:23.773096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-41c14040-ecdc-40f7-8d28-c415f88436c5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:23.794914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41c14040-ecdc-40f7-8d28-c415f88436c5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.796860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41c14040-ecdc-40f7-8d28-c415f88436c5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.801666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41c14040-ecdc-40f7-8d28-c415f88436c5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:23.802415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41c14040-ecdc-40f7-8d28-c415f88436c5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:23.869025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-41c14040-ecdc-40f7-8d28-c415f88436c5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/ips" status: 200 len: 145 microversion: 2.1 time: 0.109080 Apr 20 19:31:23.870217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 166/353] 10.222.0.38 () {58 vars in 1238 bytes} [Tue Apr 20 19:31:23 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/ips => generated 145 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:24.260101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:24.261610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:24.267259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:24.271948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:24.272816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:24.273741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:24.274349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:24.282172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8fdf7e17-fc25-4f3a-8425-e2c76b533336 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.605056 Apr 20 19:31:24.282839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 188/354] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:23 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:24.308529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:24.309284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:24.335489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:24.336070 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:24.337163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:24.337688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:25.056174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:25.072149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:25.074395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:25.075785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7eaf2822-1d7b-425d-8dd0-3ac73433a99d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.824085 Apr 20 19:31:25.076264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 167/355] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:24 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:31:25.082446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:25.083134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:25.090986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:25.091736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:25.092648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:25.093161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:25.094001 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:25.108667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c3d1674-5ca6-4b7b-a2e2-10ae0cd1a83f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.805043 Apr 20 19:31:25.120853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 189/356] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:24 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:25.300271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:25.301172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:25.309206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:25.309721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:25.310586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:25.311061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:25.663736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:25.673840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dfc50989-795a-4510-acd2-bd48a5ae4ed2 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.596272 Apr 20 19:31:25.675011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 168/357] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:25 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:25.681596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-2368b0d7-63a7-40ad-9644-776cb717f015 req-3b5a08ee-48df-4f3a-a0f2-45b8acc3dcfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a715ab-1351-439b-a1a8-4c8ad9fc2a73", "tag": "84830ef0-3a32-4ca9-88c2-b9876108356b"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:25.683868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:25.683868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:25.693989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2368b0d7-63a7-40ad-9644-776cb717f015 req-3b5a08ee-48df-4f3a-a0f2-45b8acc3dcfc service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:25.694786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2368b0d7-63a7-40ad-9644-776cb717f015 req-3b5a08ee-48df-4f3a-a0f2-45b8acc3dcfc service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:25.713275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-2368b0d7-63a7-40ad-9644-776cb717f015 req-3b5a08ee-48df-4f3a-a0f2-45b8acc3dcfc service nova] Creating event network-changed:84830ef0-3a32-4ca9-88c2-b9876108356b for instance 44a715ab-1351-439b-a1a8-4c8ad9fc2a73 on hv-cinder-78726 Apr 20 19:31:25.718314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-2368b0d7-63a7-40ad-9644-776cb717f015 req-3b5a08ee-48df-4f3a-a0f2-45b8acc3dcfc service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041418 Apr 20 19:31:25.719272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 169/358] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:25.803666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:25.813195 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-381d56d8-e6b8-477b-a1b2-25a46bf871f4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.517437 Apr 20 19:31:25.813820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 190/359] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:25 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:31:26.100589 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:26.101437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:26.110315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.110822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:26.111694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.112184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:26.128294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:26.129496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:26.137564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.138205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:26.139220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.139832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:26.690228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:26.699934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:26.707734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:26.709178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5fe650f7-f685-4360-90ee-2d053d8af16f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.613250 Apr 20 19:31:26.717972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 170/360] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:26 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:26.717972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:26.717972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:26.725550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.726070 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:26.726933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.727438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:26.739261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:26.748982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b77aae22-ce0c-4f4f-84f5-23d1e51d93ab tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.625368 Apr 20 19:31:26.749822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 191/361] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:26 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:26.757418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-854dc190-b666-4124-87c6-80543ac2dcd6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d22da28a-6782-4f2a-a323-3fd262e4db33"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:26.760048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-854dc190-b666-4124-87c6-80543ac2dcd6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:26.769332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854dc190-b666-4124-87c6-80543ac2dcd6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.770036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854dc190-b666-4124-87c6-80543ac2dcd6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:26.771099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854dc190-b666-4124-87c6-80543ac2dcd6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:26.771757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-854dc190-b666-4124-87c6-80543ac2dcd6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:27.200160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:27.219877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed3f78d7-9842-4753-b40e-1f1a009e213a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.508826 Apr 20 19:31:27.220658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-854dc190-b666-4124-87c6-80543ac2dcd6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468558 Apr 20 19:31:27.225154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 192/362] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:31:26 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:27.242031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:27.243624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:27.244503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 171/363] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:26 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:27.261887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:27.262407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:27.263443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:27.264346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:27.718976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:27.728387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:27.729220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:27.730826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-81f4a9cf-883f-4a25-8a88-ce473334f1b0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.503610 Apr 20 19:31:27.731784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 193/364] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:27 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:27.740038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:27.741095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:27.742059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:27.742657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:27.766385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:27.767075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:27.775169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:27.775684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:27.776523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:27.777240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:28.176485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:28.188610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:28.189689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:28.192090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e2669254-dc58-4498-aaf1-042806adff5e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.467739 Apr 20 19:31:28.193259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 172/365] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:27 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:31:28.194035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:28.204813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b19e742f-a5f0-4385-9879-e2219f761ae5 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.442342 Apr 20 19:31:28.206361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 194/366] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:27 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:28.238985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:28.239845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:28.254267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:28.254775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:28.255635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:28.256129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:28.578627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:28.589460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-141419b5-4204-414c-a62f-61a8c828bb03 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.354784 Apr 20 19:31:28.590289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 173/367] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:28 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:28.749463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:28.750138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:28.758740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:28.759519 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:28.760375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:28.760933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:29.011618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:29.023614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-16e24b2b-06fa-4231-91d9-e68a4c22d7e4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.277929 Apr 20 19:31:29.024801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 195/368] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:28 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:29.212483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:29.213182 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:29.224003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:29.225169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:29.229214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:29.229750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:29.230908 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:29.231416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:29.246402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:29.247090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:29.249776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:29.250486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:29.616115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:29.620395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:29.625565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a2d8d3cc-b0b4-49f6-94d3-f06f328047bb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.406119 Apr 20 19:31:29.626198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 196/369] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:29 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:29.631058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:29.631567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:29.632233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:29.632754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:29.634309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9e204f8-fab2-424b-9d4b-7d38ca335ecb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.426606 Apr 20 19:31:29.634895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 174/370] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:29 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:29.642118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:29.642626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:29.644032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:29.644530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:29.869863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:29.879266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a44c1e2d-6642-4a13-91f6-974d5f558da8 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.252020 Apr 20 19:31:29.879887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 197/371] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:29 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:30.042642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:30.043346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:30.052285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:30.053024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:30.053891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:30.054400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:30.289609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:30.298478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-84a61bc7-a053-4a3e-ac33-1f32ef6acfea tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.259879 Apr 20 19:31:30.299098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 175/372] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:30 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:30.644162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:30.644793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:30.654094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:30.654602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:30.654735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:30.655387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:30.655502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:30.655916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:30.665125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:30.665630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:30.666462 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:30.666951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:30.976018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:30.985925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7726616c-2093-4e82-81f9-d46e1f436392 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.346016 Apr 20 19:31:30.986120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:30.986564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 198/373] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:30 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:30.992369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:30.993074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:30.997075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:30.999199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:31.000383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6fcd1070-da29-4d44-868c-6761e48452de tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.349769 Apr 20 19:31:31.001018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 176/374] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:30 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:31.001179 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:31.001894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:31.002757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:31.003337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:31.223521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:31.233220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a0d99bcd-36b8-4e78-af3f-051ca5f83e26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.245451 Apr 20 19:31:31.243244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 199/375] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:30 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:31.317355 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:31.318042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:31.326111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:31.326630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:31.327491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:31.327993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:31.355632 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-569875cb-8ac5-4f98-9d4c-0f2a7ec342a7 req-7933cf25-18c9-46b0-8361-39111a32d7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8baa13b-2f85-4be8-80b7-c17f894b63c3", "name": "network-vif-plugged", "status": "completed", "tag": "7308268c-7f90-4bfd-ac50-da6e465d6946"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:31.357750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:31.357750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:31.367192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-569875cb-8ac5-4f98-9d4c-0f2a7ec342a7 req-7933cf25-18c9-46b0-8361-39111a32d7a3 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:31.367701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-569875cb-8ac5-4f98-9d4c-0f2a7ec342a7 req-7933cf25-18c9-46b0-8361-39111a32d7a3 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:31.385781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-569875cb-8ac5-4f98-9d4c-0f2a7ec342a7 req-7933cf25-18c9-46b0-8361-39111a32d7a3 service nova] Creating event network-vif-plugged:7308268c-7f90-4bfd-ac50-da6e465d6946 for instance c8baa13b-2f85-4be8-80b7-c17f894b63c3 on hv-cinder-78726 Apr 20 19:31:31.391017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-569875cb-8ac5-4f98-9d4c-0f2a7ec342a7 req-7933cf25-18c9-46b0-8361-39111a32d7a3 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039348 Apr 20 19:31:31.391883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 200/376] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:31.397981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1808587123", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:31.475864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] validate_networks() for None {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:31:31.802805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:31.811831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9bfbc89-71ef-4ba0-93b5-25a86d88cc28 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.498797 Apr 20 19:31:31.812664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 177/377] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:31 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:31.900173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:31:31.900659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:31:31.901246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:31:31.901880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:31:31.902356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:31:31.912305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:31.912879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:31.913778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:31.914381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:31.933207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Getting quotas for project 9c74c6ef848144628ba15b48ae884572. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:31:31.937563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Getting quotas for user 58da0883b9ee4efa8f093a506a4f0b60 and project 9c74c6ef848144628ba15b48ae884572. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:31:31.949138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:31:31.951876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:31:32.003643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:32.004362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:32.006016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2e0f5139-8877-4eeb-99d6-7762bfcefc1a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612857 Apr 20 19:31:32.006718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 201/378] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:31:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:31:32.013083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.013793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:32.015078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.015584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:32.017999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d922573-fc0b-4c6b-be30-86ea151f2842 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:32.019268 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d922573-fc0b-4c6b-be30-86ea151f2842 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:32.101465 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4d922573-fc0b-4c6b-be30-86ea151f2842 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:32.110690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d922573-fc0b-4c6b-be30-86ea151f2842 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1215 microversion: 2.1 time: 0.097045 Apr 20 19:31:32.111529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 202/379] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:32 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:31:32.116839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:32.117602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:32.125987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.126572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:32.128183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.128809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:32.309550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:32.319687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-59521128-931a-40a0-bb62-86ac4ebec9e4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.319709 Apr 20 19:31:32.321174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 178/380] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:31 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:31:32.326728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:32.327453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:32.336347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.337193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:32.338055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.338555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:32.408137 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:32.419302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:32.421013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:32.422242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8ede044d-2832-4bf1-b081-380083a77bb4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.309759 Apr 20 19:31:32.423036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 203/381] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:32 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:32.571402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:32.580308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b34d2ebf-1309-4075-8247-1ee47c764fa7 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.257904 Apr 20 19:31:32.581488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 179/382] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:32 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:32.831046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:32.831618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:32.839487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.839994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:32.840873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:32.841368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:33.053935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:33.062701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2aafd3ae-49d7-4cba-b6a4-033692355a9d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.235864 Apr 20 19:31:33.063315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 204/383] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:32 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:33.129892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:33.130497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:33.138537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:33.139044 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:33.139969 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:33.140459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:33.339353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:33.340324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:33.349300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:33.349300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:33.350149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:33.350654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:33.458242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:33.474328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-477066fd-e600-448e-b396-463691e40c3b tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1275 microversion: 2.1 time: 0.349019 Apr 20 19:31:33.480959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 180/384] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:33 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1275 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:33.495991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:33.501557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:33.512885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:33.513832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:33.515190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:33.515672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.236161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:34.245153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bb0ff2a1-4d9f-4636-89b9-7d48d6203cd2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1318 microversion: 2.1 time: 0.909797 Apr 20 19:31:34.245788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 205/385] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:33 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1318 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:34.250533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:34.251205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:34.259020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:34.259543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.260395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:34.260933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.267327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:34.279213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:34.281063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:34.283031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-05783873-b715-4dd7-9d71-deaf797cbf2a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1743 microversion: 2.20 time: 0.796596 Apr 20 19:31:34.284791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 181/386] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:33 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1743 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:34.296732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-cfdcf3cd-3605-4513-b99c-165331754ab3 req-158cd619-b186-4885-8b8b-62dc5d4bc1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a715ab-1351-439b-a1a8-4c8ad9fc2a73", "name": "network-vif-plugged", "status": "completed", "tag": "84830ef0-3a32-4ca9-88c2-b9876108356b"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:34.299012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:34.299012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:34.309203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-cfdcf3cd-3605-4513-b99c-165331754ab3 req-158cd619-b186-4885-8b8b-62dc5d4bc1e8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:34.309798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-cfdcf3cd-3605-4513-b99c-165331754ab3 req-158cd619-b186-4885-8b8b-62dc5d4bc1e8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.328015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-cfdcf3cd-3605-4513-b99c-165331754ab3 req-158cd619-b186-4885-8b8b-62dc5d4bc1e8 service nova] Creating event network-vif-plugged:84830ef0-3a32-4ca9-88c2-b9876108356b for instance 44a715ab-1351-439b-a1a8-4c8ad9fc2a73 on hv-cinder-78726 Apr 20 19:31:34.334318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-cfdcf3cd-3605-4513-b99c-165331754ab3 req-158cd619-b186-4885-8b8b-62dc5d4bc1e8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047762 Apr 20 19:31:34.334969 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 182/387] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:34.340879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:34.341661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:34.350622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:34.351135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.351989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:34.352498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.665514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:34.674918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-606996a9-5258-4167-aec6-f35f4c378cba tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.427917 Apr 20 19:31:34.675687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 206/388] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:34 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:34.680398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:34.681082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:34.688838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:34.689419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.690857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:34.691446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:34.781722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:34.791530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d032e28b-4a9e-43ad-8417-652b396cac63 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.455132 Apr 20 19:31:34.792246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 183/389] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:34 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:34.864536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:34.873406 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ca9e9ed5-e98f-4df1-bdee-4005a18ddd50 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1273 microversion: 2.1 time: 0.196677 Apr 20 19:31:34.874335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 207/390] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:34 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:35.263171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:35.264054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:35.272880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.273695 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:35.274742 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.275590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:35.304656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:35.305480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:35.321842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.322364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:35.323200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.328409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:35.727144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:35.736112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d974a1d0-3c55-49c8-950c-3e7ce5253a7f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1507 microversion: 2.1 time: 0.476918 Apr 20 19:31:35.736759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 184/391] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:35 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:35.741474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:35.742146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:35.750149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.750662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:35.751492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.752162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:35.914544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:35.924330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:35.926042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:35.927325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d6061816-cb2e-4cff-89c1-9fc97d735067 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1743 microversion: 2.20 time: 0.627517 Apr 20 19:31:35.939015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 208/392] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:35 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1743 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:35.939015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:35.939015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:35.945077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.945584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:35.946488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:35.946983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:36.294854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:36.306729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c59af598-ec55-4f09-a03b-c3d38a8be3ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1319 microversion: 2.1 time: 0.568866 Apr 20 19:31:36.307663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 185/393] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:35 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:36.320612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:36.321505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:36.329593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:36.330097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:36.331011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:36.331502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:36.464012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:36.476255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e4c90274-72ff-4295-9a2e-2b36ddc4e3c4 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.546654 Apr 20 19:31:36.477165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 209/394] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:35 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:36.496354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2118a724-98ab-4e14-8500-ac3408e59cba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:36.506623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2118a724-98ab-4e14-8500-ac3408e59cba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:36.507137 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2118a724-98ab-4e14-8500-ac3408e59cba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:36.730320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2118a724-98ab-4e14-8500-ac3408e59cba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Going to try to stop instance {{(pid=100562) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 19:31:36.866698 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2118a724-98ab-4e14-8500-ac3408e59cba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 202 len: 0 microversion: 2.1 time: 0.387713 Apr 20 19:31:36.870669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 210/395] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:36 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:36.875606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6ea2e958-e2e7-47bb-b299-c5a2bb07d4ce req-4d66fbe5-36cf-46b1-a23c-38885debb639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca897f-86b0-4162-a72d-2a399eef0f34", "name": "network-vif-plugged", "status": "completed", "tag": "22a8b0f9-0716-4893-9db4-55b6fdf5988e"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:36.878286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:36.878286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:36.889486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6ea2e958-e2e7-47bb-b299-c5a2bb07d4ce req-4d66fbe5-36cf-46b1-a23c-38885debb639 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:36.889947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6ea2e958-e2e7-47bb-b299-c5a2bb07d4ce req-4d66fbe5-36cf-46b1-a23c-38885debb639 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:36.910892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6ea2e958-e2e7-47bb-b299-c5a2bb07d4ce req-4d66fbe5-36cf-46b1-a23c-38885debb639 service nova] Creating event network-vif-plugged:22a8b0f9-0716-4893-9db4-55b6fdf5988e for instance 75ca897f-86b0-4162-a72d-2a399eef0f34 on hv-cinder-78726 Apr 20 19:31:36.917477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6ea2e958-e2e7-47bb-b299-c5a2bb07d4ce req-4d66fbe5-36cf-46b1-a23c-38885debb639 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047833 Apr 20 19:31:36.921269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 211/396] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:36.927003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:36.927781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:36.936774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:36.937287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:36.938291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:36.938613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:36.985874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:36.998612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f1bfba13-6cb4-4f68-9176-2d525d145b89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.689324 Apr 20 19:31:37.009008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 186/397] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:36 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:37.009008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:37.009008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:37.016035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:37.017091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:37.018666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:37.019741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:37.733693 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:37.745689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc12925d-1902-4f51-bdc1-f668a6b78540 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.823150 Apr 20 19:31:37.746753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 212/398] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:36 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:37.754232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:37.755289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:37.765326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:37.767230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:37.768357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:37.769195 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:37.797152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:37.812380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:37.826230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:37.827774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-74de2f89-93c6-4c3c-b872-6d23771924f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.827579 Apr 20 19:31:37.828578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 187/399] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:36 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:37.834767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-38cad3d2-fdff-44c9-8ef2-cc3ca9ebb5fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b092efe-9234-48f3-a363-ae16cc060b2f"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:37.836342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-38cad3d2-fdff-44c9-8ef2-cc3ca9ebb5fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:37.845489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38cad3d2-fdff-44c9-8ef2-cc3ca9ebb5fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:37.846513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38cad3d2-fdff-44c9-8ef2-cc3ca9ebb5fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:37.847614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38cad3d2-fdff-44c9-8ef2-cc3ca9ebb5fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:37.848314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38cad3d2-fdff-44c9-8ef2-cc3ca9ebb5fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:38.213505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:38.227328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4653cbc8-7870-4c07-b7cc-826311805a90 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1508 microversion: 2.1 time: 0.478759 Apr 20 19:31:38.259293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 213/400] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:37 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1508 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:38.274879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:38.286676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:38.305307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:38.314797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:38.318075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:38.318591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:38.380345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-38cad3d2-fdff-44c9-8ef2-cc3ca9ebb5fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "POST /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549731 Apr 20 19:31:38.386736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 188/401] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:31:37 2021] POST /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:38.394145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-ee7829c9-56ec-47ed-aed5-fd2ab27d8fb3 req-5e6a268e-3884-43ba-993a-01a4afa3cb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76842e5-774a-401f-9e1c-a156919bde91", "tag": "816619ad-28a2-47bd-972c-3dfb74d47b0e"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:38.395922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:38.395922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:38.424667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ee7829c9-56ec-47ed-aed5-fd2ab27d8fb3 req-5e6a268e-3884-43ba-993a-01a4afa3cb4c service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:38.425213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ee7829c9-56ec-47ed-aed5-fd2ab27d8fb3 req-5e6a268e-3884-43ba-993a-01a4afa3cb4c service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:38.474083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-ee7829c9-56ec-47ed-aed5-fd2ab27d8fb3 req-5e6a268e-3884-43ba-993a-01a4afa3cb4c service nova] Creating event network-changed:816619ad-28a2-47bd-972c-3dfb74d47b0e for instance c76842e5-774a-401f-9e1c-a156919bde91 on hv-cinder-78726 Apr 20 19:31:38.483762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-ee7829c9-56ec-47ed-aed5-fd2ab27d8fb3 req-5e6a268e-3884-43ba-993a-01a4afa3cb4c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099839 Apr 20 19:31:38.484438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 189/402] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:38.498119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:38.498893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:38.515639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:38.516158 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:38.522101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:38.522737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:39.050123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:39.060930 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1065b2a3-887d-4efd-9ad8-8d1aa3d6b9e6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.575105 Apr 20 19:31:39.069823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 190/403] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:38 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:39.082953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:39.083872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:39.097802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:39.099485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:39.103069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:39.103770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:39.146138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:39.160223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ffb07b5c-4a97-4ba2-badf-858f0ebee636 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.899472 Apr 20 19:31:39.164387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 214/404] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:38 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:39.169562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:39.176920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:39.196406 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:39.198678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:39.199950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:39.201281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:39.873086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:39.890652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:39.910371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:39.912557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:39.915928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1473badb-9375-4c08-b7d3-e3539832eac6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.748199 Apr 20 19:31:39.916059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 215/405] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:39 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:39.922069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-61d04ffc-ed8a-42fc-85e0-12accb9b91e2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.850891 Apr 20 19:31:39.922915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 191/406] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:39 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:40.087299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:40.088193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:40.098254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.099111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.100865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.102403 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.183968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:40.185275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:40.194163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.195169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.196245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.196985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.656366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:40.663645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:40.670212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e0b9dcb0-f768-4f56-b695-25dcf5123e89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.585645 Apr 20 19:31:40.670416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 216/407] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:40 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:40.676108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-23813fae-bc35-4d27-abae-f8c1dd2d8c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1501 microversion: 2.1 time: 0.496249 Apr 20 19:31:40.688851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 192/408] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:40 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1501 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:40.695266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c6d26eb-49f1-4d74-8ad3-8da0349d1671"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:40.696868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:40.705062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.705660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.707353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.707860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.775455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] HTTP exception thrown: Cannot 'attach_volume' instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de while it is in vm_state rescued Apr 20 19:31:40.776135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Returning 409 to user: Cannot 'attach_volume' instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de while it is in vm_state rescued {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:31:40.777138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-89d2af11-8667-41a3-bb1a-fa438962faf9 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087736 Apr 20 19:31:40.777819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 217/409] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:31:40 2021] POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 19:31:40.792133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b4a3a6c0-7d4e-4067-841b-c77df88682ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:40.792845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b4a3a6c0-7d4e-4067-841b-c77df88682ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:40.802632 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4a3a6c0-7d4e-4067-841b-c77df88682ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.803263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4a3a6c0-7d4e-4067-841b-c77df88682ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.804227 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4a3a6c0-7d4e-4067-841b-c77df88682ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.804842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4a3a6c0-7d4e-4067-841b-c77df88682ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.936511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:40.940531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:40.951105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.951759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:40.952759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:40.953537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:41.012218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b4a3a6c0-7d4e-4067-841b-c77df88682ec tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action" status: 202 len: 0 microversion: 2.1 time: 0.228684 Apr 20 19:31:41.013957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 193/410] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:40 2021] POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:41.021032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:41.022027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:41.030830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:41.031782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:41.033116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:41.034200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:41.564098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:41.577491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e6b41f39-0b86-428d-a984-485ad75d1121 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.561753 Apr 20 19:31:41.579641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 194/411] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:41 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:41.586278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:41.587205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:41.597528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:41.598407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:41.599460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:41.600147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:41.600670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:41.637852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:41.639572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:41.640857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b8a3cb10-5e8a-4f4f-9d56-72c758a5f76c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.710120 Apr 20 19:31:41.641471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 218/412] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:40 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:41.691694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:41.695971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:41.708678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:41.709213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:41.710070 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:41.710562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:42.515168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:42.518352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:42.530819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ac1f5b69-5ffe-4c59-84c1-cbcf0ae88b90 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.846707 Apr 20 19:31:42.531053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d614f27c-f274-4067-8190-c748df5a5faa tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1509 microversion: 2.1 time: 0.950011 Apr 20 19:31:42.544941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 219/413] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:41 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:42.548639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 195/414] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:41 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1509 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:42.598303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:42.599791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:42.615143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:42.618627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:42.619845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:42.620568 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:42.661538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:42.662507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:42.677592 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:42.678428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:42.681115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:42.684840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:43.060817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:43.084239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b22e742-ddbf-4043-8316-5742ff3f9b1a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.490501 Apr 20 19:31:43.089249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 220/415] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:42 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:43.147900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:43.158081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:43.160354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:43.161980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-29eb6cd3-917c-46ed-9355-ae6de6baa766 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.505830 Apr 20 19:31:43.162353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 196/416] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:42 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:43.553899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:43.554578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:43.554708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:43.555364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:43.562981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:43.563492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:43.564349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:43.564571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:43.564914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:43.565529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:43.566562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:43.567061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:43.965530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:43.977784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-91c181ad-c361-486e-b699-586bea5d6e3c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1509 microversion: 2.1 time: 0.428468 Apr 20 19:31:43.980063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 221/417] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:43 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:43.993951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:44.003881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8e217a6e-28e4-4957-b4d1-0c764c424f95 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.453978 Apr 20 19:31:44.004539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 197/418] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:43 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:44.107076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:44.107676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:44.116393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:44.120784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:44.120784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:44.120784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:44.196382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:44.197128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:44.227096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:44.227632 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:44.228521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:44.234801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:44.441198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:44.452972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0f76ab76-dfe8-4cc6-bd5f-918b7f741ab1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.350017 Apr 20 19:31:44.467398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 222/419] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:44 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:44.554141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:44.565941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:44.568275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:44.572634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d03eb554-6282-4629-b20c-e4d29f3d25fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.384963 Apr 20 19:31:44.573772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 198/420] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:44 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:44.996259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:44.997631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:45.015547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.016422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.023771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:45.024544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:45.028351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.031287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.044393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.045017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.045948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.046513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.420457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:45.440161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-94a4e101-840f-42ba-bb37-de875bbb0adc tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1509 microversion: 2.1 time: 0.447643 Apr 20 19:31:45.440938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 223/421] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:44 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1509 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:45.455323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:45.470108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83222fcd-895a-4252-b99f-db27f0f3bb31 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.451830 Apr 20 19:31:45.472039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:45.472746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:45.477839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 199/422] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:45 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:45.500893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.501484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.503397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.503933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.602993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:45.603663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:45.621102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.621617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.622488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.622986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.880423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:45.892585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9bffba8-f4d9-4fae-b32b-70bdb7044818 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.424792 Apr 20 19:31:45.894590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 224/423] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:45 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:31:45.899529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-389b2be6-bad3-4f8c-a3c4-c742301b9319 req-c6027d9d-4c37-4502-8b2b-2437267d2478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76842e5-774a-401f-9e1c-a156919bde91", "name": "network-vif-plugged", "status": "completed", "tag": "816619ad-28a2-47bd-972c-3dfb74d47b0e"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:45.901739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:45.901739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:45.912826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-389b2be6-bad3-4f8c-a3c4-c742301b9319 req-c6027d9d-4c37-4502-8b2b-2437267d2478 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:45.913492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-389b2be6-bad3-4f8c-a3c4-c742301b9319 req-c6027d9d-4c37-4502-8b2b-2437267d2478 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:45.933585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-389b2be6-bad3-4f8c-a3c4-c742301b9319 req-c6027d9d-4c37-4502-8b2b-2437267d2478 service nova] Creating event network-vif-plugged:816619ad-28a2-47bd-972c-3dfb74d47b0e for instance c76842e5-774a-401f-9e1c-a156919bde91 on hv-cinder-78726 Apr 20 19:31:45.940454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-389b2be6-bad3-4f8c-a3c4-c742301b9319 req-c6027d9d-4c37-4502-8b2b-2437267d2478 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043882 Apr 20 19:31:45.941398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 225/424] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:45.973489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:45.989951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:46.004576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:46.006646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0198970-0479-4118-a4d8-8d98a6731d42 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.411740 Apr 20 19:31:46.007538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 200/425] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:45 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:46.459169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:46.460782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:46.479751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:46.480372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:46.481809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:46.482549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:46.493003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:46.493914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:46.509793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:46.512310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:46.514703 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:46.517231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:46.868505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:46.878474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2a16bd9e-be27-4559-8c80-8ca63555dbae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1509 microversion: 2.1 time: 0.423706 Apr 20 19:31:46.889620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 226/426] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:46 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:46.897859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:46.906931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-484edb0c-588e-4b0d-99c9-ccf097062910 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.418361 Apr 20 19:31:46.907713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 201/427] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:46 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:46.912105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:46.912988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:46.922405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:46.922996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:46.923983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:46.925313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:47.027424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:47.028097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:47.039245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:47.039797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:47.041020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:47.041530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:47.282315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:47.293626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d5489db2-3220-4a4b-8557-c5ddf7457d5d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.386510 Apr 20 19:31:47.294723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 227/428] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:46 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:47.370753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:47.386683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:47.388558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:47.389907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9d3bb2ec-9ed0-4e46-ad5d-47a2114ab623 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.366593 Apr 20 19:31:47.390801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 202/429] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:47 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:47.896405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:47.897176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:47.910826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:47.911345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:47.912211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:47.912722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:47.926260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:47.927202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:47.950338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:47.951132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:47.952145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:47.952807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:48.278453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:48.289179 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1afc1001-6c23-401c-b405-743b7d5a06da tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1515 microversion: 2.1 time: 0.397397 Apr 20 19:31:48.301134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 228/430] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:47 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:48.301134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:48.301134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:48.306901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:48.320858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dfd6091e-34c6-45c8-95e6-98cfcf5f443c tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.398632 Apr 20 19:31:48.321637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 203/431] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:47 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:48.334247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:48.334765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:48.335636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:48.336137 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:48.353465 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:48.354141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:48.362633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:48.363356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:48.364593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:48.365600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:48.561057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'services' on Instance uuid c8baa13b-2f85-4be8-80b7-c17f894b63c3 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:31:48.626922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:48.639533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-438163b9-231a-4857-b3a1-9c6f97a5228b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.294028 Apr 20 19:31:48.643120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 204/432] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:48 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:48.644951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:48.645604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:48.653874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:48.654385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:48.655988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:48.656484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:48.731343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-735e1009-b9bd-48e9-8f52-f7b869bc36b4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3/os-volume_attachments/5b092efe-9234-48f3-a363-ae16cc060b2f" status: 202 len: 0 microversion: 2.1 time: 0.439916 Apr 20 19:31:48.732152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 229/433] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:31:48 2021] DELETE /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3/os-volume_attachments/5b092efe-9234-48f3-a363-ae16cc060b2f => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:48.895049 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:48.904625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:48.906515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:48.907744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cf002425-7329-41ed-a58b-dd58a604eb8e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1738 microversion: 2.20 time: 0.266595 Apr 20 19:31:48.909139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 205/434] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:48 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:49.340469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:49.341289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:49.350205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:49.350716 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:49.351570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:49.352163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:49.577102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:49.586867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-37e5eaff-b236-47d6-a3e1-a0e6122d7bcc tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1315 microversion: 2.1 time: 0.250913 Apr 20 19:31:49.587498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 230/435] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:49 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:49.658544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:49.659240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:49.667374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:49.667887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:49.668756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:49.669274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:49.928891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:49.929563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:49.938090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:49.938591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:49.939449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:49.940514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:50.061210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:50.071240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2377be42-085e-4107-8805-b03282229592 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.417049 Apr 20 19:31:50.071873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 206/436] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:49 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:50.076545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:50.077241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:50.085265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:50.085784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:50.086634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:50.087132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:50.642011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:50.651990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:50.653711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:50.654945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-61cd3cc3-e2be-4b45-acfc-05386d3f60b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1720 microversion: 2.20 time: 0.731074 Apr 20 19:31:50.655753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 231/437] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:49 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1720 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:50.660758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:50.661411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:50.669234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:50.669739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:50.670578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:50.671071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:50.748281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:50.761897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6034b274-1ec7-4b73-bbd1-a1d76e5cfe46 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1515 microversion: 2.1 time: 0.688871 Apr 20 19:31:50.762537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 207/438] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:50 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1515 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:50.780170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cab2fd7c-7bfb-4884-bfe5-03b52461341f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75d87cd5-389f-475a-8913-f35731454737"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:50.781489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cab2fd7c-7bfb-4884-bfe5-03b52461341f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:50.790174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cab2fd7c-7bfb-4884-bfe5-03b52461341f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:50.790689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cab2fd7c-7bfb-4884-bfe5-03b52461341f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:50.791550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cab2fd7c-7bfb-4884-bfe5-03b52461341f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:50.792098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cab2fd7c-7bfb-4884-bfe5-03b52461341f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.067859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:51.079081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-da9582e7-3398-4759-8a4a-48ab9b5655ac tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1464 microversion: 2.1 time: 0.422367 Apr 20 19:31:51.079874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 232/439] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:50 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1464 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:51.100018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:51.101105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:51.115291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.115873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.116831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.117381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.249580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cab2fd7c-7bfb-4884-bfe5-03b52461341f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473852 Apr 20 19:31:51.256576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 208/440] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:31:50 2021] POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments => generated 194 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:31:51.262995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:51.263793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:51.275801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.276810 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.277854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.278400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.354632 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:31:51.465248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:51.477113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f373e4cb-4e3d-4777-b050-632a613e0ed1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.382033 Apr 20 19:31:51.489014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 233/441] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:51 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:51.498741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-25cf0df3-563e-4f53-a160-d91ea3121ed0 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 204 len: 0 microversion: 2.1 time: 0.240292 Apr 20 19:31:51.502719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 209/442] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:31:51 2021] DELETE /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:31:51.509361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:51.510110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:51.519661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.520163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.521072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.521585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.676491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:51.678141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:51.687100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.687752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.688972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:51.693472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:51.763688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:51.773614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6d01d9b-c5db-48af-856b-8c1ca7e93f3e tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1470 microversion: 2.1 time: 0.269206 Apr 20 19:31:51.774490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 234/443] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:51 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:51.925865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:51.935394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:51.937087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:51.938304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-312d5280-c462-432d-b13d-efc0b38940a5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1720 microversion: 2.20 time: 0.266560 Apr 20 19:31:51.938910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 210/444] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:51 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:52.436376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:52.436861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:52.445505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.446022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.446870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.447373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.495583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:52.496313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:52.504752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.505631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.506110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.506608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.520028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:31:52.648629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f57ccf31-d029-4867-ba1e-3d3ca94c538f tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 204 len: 0 microversion: 2.1 time: 0.216016 Apr 20 19:31:52.649756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 235/445] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:31:52 2021] DELETE /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:31:52.661409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:52.662188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:52.675506 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.676062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.677226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.677711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.761020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:52.772607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-77e31cf5-e35a-42f3-9fe2-e3fd5495a027 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1721 microversion: 2.1 time: 0.280898 Apr 20 19:31:52.773510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 211/446] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:52 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:52.793995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:52.794709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:52.803229 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.803733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.804573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:52.805098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:52.981933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:52.991037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ceebd0e8-d11c-43c1-929e-6ba21466fca8 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1513 microversion: 2.1 time: 0.336681 Apr 20 19:31:52.991636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 236/447] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:52 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:31:52.996465 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:52.997152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:53.005332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:53.005835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:53.006675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:53.007167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:53.064125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:53.073056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6d1d9217-746b-4cea-96f7-3e9ad816f045 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1470 microversion: 2.1 time: 0.283094 Apr 20 19:31:53.073694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 212/448] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:52 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:31:53.225615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:53.235141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:53.237591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:53.239037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-26dc81cc-fd88-4397-8c5d-a5552265cfa6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1720 microversion: 2.20 time: 0.246388 Apr 20 19:31:53.239859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 237/449] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:52 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1720 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:53.379056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-e46131d7-3c2f-4a9e-964e-c21c9ced0fb9 req-b7c2d983-548c-4fed-bb86-b3da1253b492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca897f-86b0-4162-a72d-2a399eef0f34", "name": "network-vif-unplugged", "status": "completed", "tag": "22a8b0f9-0716-4893-9db4-55b6fdf5988e"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:53.380922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:53.380922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:53.389936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e46131d7-3c2f-4a9e-964e-c21c9ced0fb9 req-b7c2d983-548c-4fed-bb86-b3da1253b492 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:53.390434 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e46131d7-3c2f-4a9e-964e-c21c9ced0fb9 req-b7c2d983-548c-4fed-bb86-b3da1253b492 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:53.411482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-e46131d7-3c2f-4a9e-964e-c21c9ced0fb9 req-b7c2d983-548c-4fed-bb86-b3da1253b492 service nova] Creating event network-vif-unplugged:22a8b0f9-0716-4893-9db4-55b6fdf5988e for instance 75ca897f-86b0-4162-a72d-2a399eef0f34 on hv-cinder-78726 Apr 20 19:31:53.416875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-e46131d7-3c2f-4a9e-964e-c21c9ced0fb9 req-b7c2d983-548c-4fed-bb86-b3da1253b492 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041880 Apr 20 19:31:53.417706 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 213/450] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:53 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:53.790858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:53.791530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:53.800102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:53.800607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:53.802133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:53.802794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.010287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:54.011064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:54.019316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.019827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.020733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.021233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.026206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:54.037384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e5c570f-e77d-467f-ab51-90988502dcc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1698 microversion: 2.1 time: 0.250265 Apr 20 19:31:54.037953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 238/451] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:53 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1698 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:54.054881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f019e39-3271-4dc3-b0d3-ce9f27bc2859 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:54.062781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f019e39-3271-4dc3-b0d3-ce9f27bc2859 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.063282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f019e39-3271-4dc3-b0d3-ce9f27bc2859 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.127471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f019e39-3271-4dc3-b0d3-ce9f27bc2859 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Going to try to start instance {{(pid=100562) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 19:31:54.208893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f019e39-3271-4dc3-b0d3-ce9f27bc2859 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 202 len: 0 microversion: 2.1 time: 0.157514 Apr 20 19:31:54.210029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 239/452] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:31:54 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:31:54.216996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:54.217777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:54.226702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.227309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.228154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.228649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.253058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:54.262561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8ca9cd6f-79bd-47ab-98c9-31265ac0549c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1513 microversion: 2.1 time: 0.256834 Apr 20 19:31:54.263306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 214/453] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:54 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:31:54.270374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:54.271055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:54.280030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.280543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.281418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.281911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.622546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:54.630571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:54.632218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e57f5d39-0705-4d85-9e94-8c04e336338a tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1470 microversion: 2.1 time: 0.421271 Apr 20 19:31:54.632935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 240/454] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:54 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1470 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:54.642241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:54.642464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed925b65-c7c8-4c89-bfa9-0d7059712a17 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1707 microversion: 2.1 time: 0.375052 Apr 20 19:31:54.642553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:54.642677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 215/455] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:54 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1707 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:54.652273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.652823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:54.653812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:54.654314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:55.060066 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:55.071339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:55.073045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:55.074276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-863d3cdf-bae6-46da-9ef1-94e6804f55fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1720 microversion: 2.20 time: 0.440292 Apr 20 19:31:55.075109 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 241/456] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:54 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1720 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:55.289304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:55.290321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:55.300729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:55.301431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:55.302400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:55.303111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:55.656030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:55.656030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:55.665732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:55.666448 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:55.667457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:55.668078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.016405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:56.029840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c1957ffd-76d5-4ce4-a627-e6d6aeb14916 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1513 microversion: 2.1 time: 0.744604 Apr 20 19:31:56.040686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 216/457] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:55 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1513 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:56.043547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:56.044251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:56.054477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:56.054992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.056354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:56.056891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.120654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:56.137640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-884a39b5-6ff4-4062-a3eb-e70ed41c3fd6 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1470 microversion: 2.1 time: 0.486979 Apr 20 19:31:56.140076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 242/458] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:55 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1470 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:56.143543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:56.144411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:56.165551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:56.165551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.165551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:56.165551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.461599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:56.466364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:56.473048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-17ab7261-8fbf-4e4b-b793-ef945d855e5c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1707 microversion: 2.1 time: 0.440803 Apr 20 19:31:56.473695 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 217/459] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:56 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1707 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:56.478648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a29319ab-cd01-4b14-8981-9338e7c54c18 req-cd979208-9c3f-4300-a910-02e5ef132682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76842e5-774a-401f-9e1c-a156919bde91", "name": "network-vif-deleted", "tag": "816619ad-28a2-47bd-972c-3dfb74d47b0e"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:56.480400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:56.480400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:56.490986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a29319ab-cd01-4b14-8981-9338e7c54c18 req-cd979208-9c3f-4300-a910-02e5ef132682 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:56.491492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a29319ab-cd01-4b14-8981-9338e7c54c18 req-cd979208-9c3f-4300-a910-02e5ef132682 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.492073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:56.493769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:56.495062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a38b03c0-a3b3-4b2c-abfd-d69db4e1a107 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1723 microversion: 2.20 time: 0.355745 Apr 20 19:31:56.495838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 243/460] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:56 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:56.513996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f8e21d03-1913-44d4-a9f4-8a993f6fa361 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d870da37-f83f-426f-8e93-be3986bde5e8"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:56.515270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f8e21d03-1913-44d4-a9f4-8a993f6fa361 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:56.522900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a29319ab-cd01-4b14-8981-9338e7c54c18 req-cd979208-9c3f-4300-a910-02e5ef132682 service nova] Creating event network-vif-deleted:816619ad-28a2-47bd-972c-3dfb74d47b0e for instance c76842e5-774a-401f-9e1c-a156919bde91 on hv-cinder-78726 Apr 20 19:31:56.524319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e21d03-1913-44d4-a9f4-8a993f6fa361 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:56.524846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e21d03-1913-44d4-a9f4-8a993f6fa361 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.525700 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e21d03-1913-44d4-a9f4-8a993f6fa361 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:56.526198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8e21d03-1913-44d4-a9f4-8a993f6fa361 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:56.528658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a29319ab-cd01-4b14-8981-9338e7c54c18 req-cd979208-9c3f-4300-a910-02e5ef132682 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053646 Apr 20 19:31:56.529704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 218/461] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:57.006373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f8e21d03-1913-44d4-a9f4-8a993f6fa361 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.496433 Apr 20 19:31:57.007068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 244/462] 10.222.0.38 () {62 vars in 1354 bytes} [Tue Apr 20 19:31:56 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-volume_attachments => generated 188 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:31:57.050355 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:57.050922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:57.059831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.060495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.061681 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.062287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.155839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:57.160387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:57.177042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.177462 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.181633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.182154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.320234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.320973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.321495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lazy-loading 'fault' on Instance uuid c76842e5-774a-401f-9e1c-a156919bde91 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:31:57.411172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58da0883b9ee4efa8f093a506a4f0b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74c6ef848144628ba15b48ae884572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:57.437195 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f96f3e39-d451-4206-b9f9-d92d7b205a89 tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 200 len: 1305 microversion: 2.1 time: 0.285254 Apr 20 19:31:57.437863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 245/463] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:57 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:57.443177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cf5b3ea0-1504-4c20-be4a-7351c7b4e74e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:57.444086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cf5b3ea0-1504-4c20-be4a-7351c7b4e74e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:57.452198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf5b3ea0-1504-4c20-be4a-7351c7b4e74e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.453095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf5b3ea0-1504-4c20-be4a-7351c7b4e74e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.454122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf5b3ea0-1504-4c20-be4a-7351c7b4e74e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.454617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cf5b3ea0-1504-4c20-be4a-7351c7b4e74e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.484415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:57.500003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0027d828-03c6-430c-904c-7089f19721d2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 200 len: 1513 microversion: 2.1 time: 0.455982 Apr 20 19:31:57.510389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 219/464] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:57 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:57.510389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:57.510389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:57.517188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.518071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.519207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.519825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.644512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cf5b3ea0-1504-4c20-be4a-7351c7b4e74e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action" status: 202 len: 0 microversion: 2.20 time: 0.205542 Apr 20 19:31:57.645572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 246/465] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:31:57 2021] POST /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:31:57.653914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:57.677530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:57.688495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.689139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.690771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:57.691340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:57.905383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:57.934498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44b80c25-ab93-4b86-86e9-c41af87b11cf tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1711 microversion: 2.1 time: 0.431489 Apr 20 19:31:57.936803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 220/466] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:57 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1711 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:31:58.036238 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:58.046560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:58.048233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:58.050295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2bdf067e-03d2-446d-b10f-b91b0c418b00 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1749 microversion: 2.20 time: 0.400418 Apr 20 19:31:58.051038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 247/467] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:57 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1749 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:58.455688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:58.456981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] [instance: c76842e5-774a-401f-9e1c-a156919bde91] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:58.476320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:58.477103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:58.478112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:58.478759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:58.520145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:58.521143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: c8baa13b-2f85-4be8-80b7-c17f894b63c3] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:58.535184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:58.536017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:58.537138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:58.537832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:58.548083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] HTTP exception thrown: Instance c76842e5-774a-401f-9e1c-a156919bde91 could not be found. Apr 20 19:31:58.548789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] Returning 404 to user: Instance c76842e5-774a-401f-9e1c-a156919bde91 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:31:58.549897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a24137e2-7e49-4a33-ad7b-5adf9bcae84f tempest-VolumesNegativeTest-1262743768 tempest-VolumesNegativeTest-1262743768-project] 10.222.0.38 "GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91" status: 404 len: 111 microversion: 2.1 time: 0.098469 Apr 20 19:31:58.550965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 221/468] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:58 2021] GET /compute/v2.1/servers/c76842e5-774a-401f-9e1c-a156919bde91 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:31:58.629606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] HTTP exception thrown: Instance c8baa13b-2f85-4be8-80b7-c17f894b63c3 could not be found. Apr 20 19:31:58.630439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Returning 404 to user: Instance c8baa13b-2f85-4be8-80b7-c17f894b63c3 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:31:58.631476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-96ff00f0-06c6-487b-9237-bd3be2dbf8fb tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3" status: 404 len: 111 microversion: 2.1 time: 0.117029 Apr 20 19:31:58.632503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 248/469] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:31:58 2021] GET /compute/v2.1/servers/c8baa13b-2f85-4be8-80b7-c17f894b63c3 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:31:58.645305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-96575d33-d7b3-4804-a64a-8b88653a90d1 req-3f98dd8d-9f32-4731-9438-6aff3c8a24c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8baa13b-2f85-4be8-80b7-c17f894b63c3", "name": "network-vif-deleted", "tag": "7308268c-7f90-4bfd-ac50-da6e465d6946"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:31:58.647615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:31:58.647615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:31:58.671076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-96575d33-d7b3-4804-a64a-8b88653a90d1 req-3f98dd8d-9f32-4731-9438-6aff3c8a24c5 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:58.671889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-96575d33-d7b3-4804-a64a-8b88653a90d1 req-3f98dd8d-9f32-4731-9438-6aff3c8a24c5 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:58.696728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-96575d33-d7b3-4804-a64a-8b88653a90d1 req-3f98dd8d-9f32-4731-9438-6aff3c8a24c5 service nova] Creating event network-vif-deleted:7308268c-7f90-4bfd-ac50-da6e465d6946 for instance c8baa13b-2f85-4be8-80b7-c17f894b63c3 on hv-cinder-78726 Apr 20 19:31:58.703007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-96575d33-d7b3-4804-a64a-8b88653a90d1 req-3f98dd8d-9f32-4731-9438-6aff3c8a24c5 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062431 Apr 20 19:31:58.703949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 222/470] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:31:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:31:59.070036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:59.070696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:59.079208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:59.079751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:59.081160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:59.081654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:59.344199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:59.360283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:59.364138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:31:59.365948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad02e310-0d00-4e15-ae31-5ded24f2b4f0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1749 microversion: 2.20 time: 0.299845 Apr 20 19:31:59.366798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 249/471] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:31:59 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1749 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:31:59.946023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:31:59.946684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:31:59.959509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:59.960116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:31:59.961203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:31:59.961784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.028003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:32:00.150583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-80f90ff1-19c0-43b5-9d1c-8a20de5619e7 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "DELETE /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 204 len: 0 microversion: 2.1 time: 0.209359 Apr 20 19:32:00.151394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 223/472] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:31:59 2021] DELETE /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:32:00.161171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:00.161901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:00.169689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.170208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.171230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.171760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.324697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:00.325775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:00.335514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.336932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.337775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.338279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.410606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lazy-loading 'flavor' on Instance uuid c9c99e67-a6e2-4f90-bb81-d4e3f368f1de {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:00.429241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:00.438476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9d8f89ab-d75f-4b43-ac67-0ad2dad599a2 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1513 microversion: 2.1 time: 0.282829 Apr 20 19:32:00.439390 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 250/473] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:00 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:00.459154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:00.460073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:00.469527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.470269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.471873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.473035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.707973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:00.718801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:00.720887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:00.722456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-14477bf1-c72f-4e72-affd-76cf25ad2c8c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1751 microversion: 2.20 time: 0.268956 Apr 20 19:32:00.723163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 251/474] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:00 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:00.815570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-273163eb-134f-4feb-abe4-bf6f6acf0b27 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action" status: 200 len: 32 microversion: 2.1 time: 0.495643 Apr 20 19:32:00.816687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 224/475] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:32:00 2021] POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action => generated 32 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:32:00.826740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:00.827399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:00.837154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.837924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:00.838775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:00.839453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:01.075094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:01.085429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1e52520d-29b9-4548-baa4-010dca8924b8 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.263191 Apr 20 19:32:01.086439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 252/476] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:00 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:01.458227 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:01.459229 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:01.467842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:01.468593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:01.469647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:01.470304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:01.742781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:01.743804 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:01.752511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:01.753299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:01.754433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:01.755010 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:01.806162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:01.824253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e6138a6d-dd06-4e49-af3e-83a4de862f25 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1513 microversion: 2.1 time: 0.370626 Apr 20 19:32:01.825399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 225/477] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:01 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:02.103625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:02.104869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:02.112849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:02.113360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:02.114199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:02.114682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:02.174345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:02.192547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:02.194251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:02.195500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb5e1953-924d-45d7-8b0e-4915ca81b0be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1751 microversion: 2.20 time: 0.456796 Apr 20 19:32:02.196766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 253/478] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:01 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1751 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:02.505235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:02.515327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8261ea2a-c034-4e50-a285-297811e52f6a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.415761 Apr 20 19:32:02.516051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 226/479] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:02 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:02.843318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:02.843914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:02.852397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:02.852946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:02.853782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:02.854274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:03.135420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:03.146115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d371e5b0-270b-4dba-97e9-800b98e76a75 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1513 microversion: 2.1 time: 0.306787 Apr 20 19:32:03.146736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 254/480] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:02 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1513 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:03.216924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:03.218046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:03.227431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:03.228047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:03.229113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:03.229691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:03.534272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:03.534978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:03.543094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:03.543594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:03.544423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:03.544943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:04.071985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:04.086478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:04.091339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:04.095931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b9657d36-db98-4af8-a073-94bc6b2c80d4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.884231 Apr 20 19:32:04.099926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 227/481] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:03 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:04.170573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:04.199896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:04.201882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:04.204391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c018c055-b6d2-4488-8fe3-2b4205c82ea0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.674485 Apr 20 19:32:04.208999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 255/482] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:03 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:04.217335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:04.217937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:04.221523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:04.222675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:04.636057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-dc2a8437-fba7-4518-88bf-82ce1e4616cd req-b354c479-dd55-4489-9693-938f4f12e83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2a7a38-b159-42bc-8b4a-e137ac5ea64d", "name": "network-vif-deleted", "tag": "bad69e7f-11c2-477d-a791-ffe7c816a6f4"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:04.637893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:04.637893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:32:04.657353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-dc2a8437-fba7-4518-88bf-82ce1e4616cd req-b354c479-dd55-4489-9693-938f4f12e83f service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:04.658555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-dc2a8437-fba7-4518-88bf-82ce1e4616cd req-b354c479-dd55-4489-9693-938f4f12e83f service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:04.722323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-dc2a8437-fba7-4518-88bf-82ce1e4616cd req-b354c479-dd55-4489-9693-938f4f12e83f service nova] Creating event network-vif-deleted:bad69e7f-11c2-477d-a791-ffe7c816a6f4 for instance 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d on hv-cinder-78726 Apr 20 19:32:04.739340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-dc2a8437-fba7-4518-88bf-82ce1e4616cd req-b354c479-dd55-4489-9693-938f4f12e83f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113413 Apr 20 19:32:04.740825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 256/483] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:04.840651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:04.857257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a457f016-6128-46e6-ab25-760031af5421 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1513 microversion: 2.1 time: 0.674046 Apr 20 19:32:04.858420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 228/484] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:04 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1513 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:05.119779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:05.120663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:05.129195 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:05.129716 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:05.130873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:05.131385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:05.234302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:05.234995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:05.251634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:05.252869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:05.253928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:05.254582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:05.402735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:05.416763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:05.418729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:05.420321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a9754b58-f160-44fa-a9d5-9b9fe6b6819c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.305166 Apr 20 19:32:05.421167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 257/485] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:05 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:05.639692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:05.651192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8fb2b7d3-4ca0-48a8-93a5-91d9c430759c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.428260 Apr 20 19:32:05.651823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 229/486] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:05 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:05.876556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:05.877877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:05.885929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:05.886454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:05.887296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:05.887983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:05.965572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:05.966093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:05.966612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:06.069521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:06.079484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-94040aa0-0536-48d4-827d-0ed9eccae41a tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.207534 Apr 20 19:32:06.081920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 258/487] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:05 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:06.346198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07642bda-70bc-43e7-803d-3bfbd04a9495 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d296a6c-1399-4f6b-9185-39bc868b9cd0", "device": "/dev/sdb"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:06.348125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07642bda-70bc-43e7-803d-3bfbd04a9495 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:06.356638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07642bda-70bc-43e7-803d-3bfbd04a9495 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:06.357297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07642bda-70bc-43e7-803d-3bfbd04a9495 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:06.358239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07642bda-70bc-43e7-803d-3bfbd04a9495 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:06.358954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07642bda-70bc-43e7-803d-3bfbd04a9495 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:06.441301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:06.442425 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:06.451036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:06.451686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:06.452592 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:06.453138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:06.687641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:06.698253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:06.699923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:06.701251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f1449591-1ab2-476d-8f8b-03233d2c6a69 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.265752 Apr 20 19:32:06.701876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 259/488] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:06 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:06.706884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:06.707535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:06.715153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:06.715672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:06.716523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:06.717084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:06.950380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:06.960398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-df33bfb2-7d3f-4047-bde4-ed290c7723cf tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.257506 Apr 20 19:32:06.961056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 260/489] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:06 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:07.098984 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:07.099649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:07.107504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:07.108006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:07.108877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:07.109372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:07.184999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:07.185512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:07.186027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:07.293143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:07.302485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-de63be69-c875-4c1c-92c2-256e3da394c1 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.208234 Apr 20 19:32:07.303113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 261/490] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:07 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:07.724082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:07.725459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:07.733896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:07.734534 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:07.735628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:07.736912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:07.955177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:07.966432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:07.968473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:07.969946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-628a4d58-f380-4587-88a4-a6595a8a5768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.252195 Apr 20 19:32:07.972985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 262/491] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:07 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:07.992627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:07.993528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:08.004309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:08.004935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:08.005923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:08.006487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:08.230749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:08.240301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-47c3ffab-cd5a-4bed-ac97-bea4176d4d5e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.252802 Apr 20 19:32:08.240960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 263/492] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:07 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:08.322255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:08.322938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:08.332228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:08.332779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:08.333651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:08.334153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:08.410292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:08.410811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:08.411342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:08.476614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:08.485707 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a86832be-5b42-4281-885f-7b42e087b81c tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.167574 Apr 20 19:32:08.486997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 264/493] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:08 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:08.995222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:08.995817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:09.003747 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:09.004255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:09.005146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:09.005637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:09.252112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:09.262116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:09.263783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:09.265042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-baae0487-a996-487d-99e8-54b5081b6dd6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.274054 Apr 20 19:32:09.265657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 265/494] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:08 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:09.270787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:09.271450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:09.280093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:09.280949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:09.282019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:09.282670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:09.515870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:09.529047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b5259d1f-7ad1-4d25-9a12-fa10f162faf7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.261988 Apr 20 19:32:09.529759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 266/495] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:09 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:09.537254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:09.540628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:09.550213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:09.550728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:09.551752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:09.552270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:09.634262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:09.634773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:09.635288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:09.698569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:09.707575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6e6a4220-13a1-4661-be2f-8e6e0f96caa3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.176762 Apr 20 19:32:09.708207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 267/496] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:09 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:10.285559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:10.286232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:10.294074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:10.294586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:10.295413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:10.295910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:10.521880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:10.532363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:10.534626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:10.535925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07ac3d6a-b325-4236-9a02-196b1a639878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.254936 Apr 20 19:32:10.536512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 268/497] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:10 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:10.547397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:10.548059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:10.556530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:10.557085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:10.557914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:10.558403 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:10.799877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:10.809365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1bd5b8f3-e444-472b-93ee-fd4d1ed25f38 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.265636 Apr 20 19:32:10.809994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 269/498] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:10 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:10.814728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:10.815381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:10.822786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:10.823299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:10.824142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:10.824643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:10.902040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:10.902830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:10.905866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:10.979573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:10.988579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-057b2f3a-ad57-4a41-bf80-7031e6fd071b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.177555 Apr 20 19:32:10.989270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 270/499] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:10 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:11.555949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:11.556624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:11.573164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:11.573675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:11.574575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:11.575024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:11.855510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:11.869688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:11.871974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:11.873298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8bdb81ea-7190-4aaf-976a-88510404376f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.321492 Apr 20 19:32:11.873935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 271/500] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:11 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:11.879824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:11.880508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:11.888682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:11.889250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:11.890096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:11.890600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:12.135495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:12.145300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c6352c2-4cbf-482f-a5eb-cac155cfd6ae tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.270208 Apr 20 19:32:12.146372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 272/501] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:11 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:12.151107 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:12.151864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:12.160581 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:12.161217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:12.162169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:12.162673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:12.237203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:12.237719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:12.238298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:12.306249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:12.316252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ef3013d8-93ba-4734-a570-f88375890019 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.168917 Apr 20 19:32:12.318949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 273/502] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:12 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:12.894839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:12.895517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:12.903919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:12.904439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:12.905351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:12.905856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:13.131739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:13.142725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:13.144537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:13.146389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c1c68e9-8da5-4150-b990-bd31367b9664 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.256640 Apr 20 19:32:13.147256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 274/503] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:12 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:13.164215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:13.164934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:13.173256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:13.174271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:13.175231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:13.175736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:13.390963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:13.401221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b6e6415-b5d7-449f-8722-897cd8fc70dd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.240963 Apr 20 19:32:13.401802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 275/504] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:13 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:13.406465 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:13.407138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:13.419768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:13.420285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:13.421178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:13.421679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:13.500219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:13.500748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:13.501270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:13.572275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:13.582613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-70b4fe56-1584-4750-b6cd-9148e10a325b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.179760 Apr 20 19:32:13.583224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 276/505] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:13 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:14.166665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:14.167320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:14.175228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:14.175743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:14.176590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:14.177118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:14.406486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:14.418051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:14.419759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:14.421016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8bd69c3d-b2b2-4d36-95a0-e505ad5202dd tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.258524 Apr 20 19:32:14.421715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 277/506] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:14 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:14.426981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:14.427640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:14.435607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:14.436208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:14.437098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:14.437660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:14.688480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:14.699436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9437dee0-aa01-4e70-ad7c-aca9f0442c3b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.276606 Apr 20 19:32:14.700080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 278/507] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:14 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:14.704908 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:14.705934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:14.713882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:14.714396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:14.715250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:14.715751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:14.796380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:14.796929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:14.797466 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:14.879410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:14.882503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a2d65f47-e0c7-4a25-984e-3534cfb57573 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.181327 Apr 20 19:32:14.883142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 279/508] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:14 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:15.441303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:15.442168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:15.460946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:15.461453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:15.462304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:15.462779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:15.699652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:15.712954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:15.715106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:15.716414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e85defad-0593-41ea-aa4d-70f33c5f7b80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.279859 Apr 20 19:32:15.717308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 280/509] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:15 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:15.732996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:15.733664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:15.741823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:15.742333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:15.743164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:15.743656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:16.105437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:16.118260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-20a715ed-99c5-4b5c-85de-806c0c95c25e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.389207 Apr 20 19:32:16.119399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 281/510] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:15 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:16.125361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:16.126284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:16.136159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:16.136867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:16.137713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:16.138212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:16.214157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:16.214657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:16.215170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:16.288378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:16.297317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fd992841-f4ed-41e9-af4d-7533eba94a18 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.176516 Apr 20 19:32:16.297939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 282/511] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:16 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:16.735673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:16.736303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:16.744235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:16.744774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:16.745623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:16.746126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:17.165753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:17.175772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:17.177514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:17.178741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-960e2065-51f5-43a3-a4ec-ce786bd663a8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.447233 Apr 20 19:32:17.179351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 283/512] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:16 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:17.183911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:17.184657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:17.193393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:17.193917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:17.194785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:17.195422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:17.415407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:17.425476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3873cf40-f32d-40d0-a7bd-a72056767ad3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.245093 Apr 20 19:32:17.426100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 284/513] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:17 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:17.430752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:17.431423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:17.439563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:17.440572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:17.441996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:17.445345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:17.522498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:17.523022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:17.523537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:17.586683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:17.595528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44e5afcd-b728-4884-aeae-5840e6a0e960 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.168361 Apr 20 19:32:17.596142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 285/514] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:17 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:18.198908 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:18.199517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:18.208047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:18.208557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:18.209446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:18.209946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:18.421715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:18.432392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:18.434093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:18.435331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed6f1816-d60a-4f0d-b7db-32c6be99aa25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.240537 Apr 20 19:32:18.435982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 286/515] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:18 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:18.442963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:18.443639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:18.451428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:18.451894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:18.452757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:18.453261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:18.671275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:18.681365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7d123ad5-5bf5-497b-863c-6834ba030e01 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.242653 Apr 20 19:32:18.681985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 287/516] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:18 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:18.686621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:18.687293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:18.695352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:18.695865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:18.696738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:18.697247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:18.770978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:18.771489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:18.772008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:18.834279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:18.843053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9e05bd6f-2511-4fa3-9081-a62a3cffcb89 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.160038 Apr 20 19:32:18.843680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 288/517] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:18 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:19.456617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:19.457354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:19.465479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:19.465990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:19.466842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:19.467790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:19.686586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:19.696610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:19.698310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:19.699540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6e2578a9-e571-4866-aafd-853465722e10 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.247138 Apr 20 19:32:19.700148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 289/518] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:19 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:19.705273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:19.705937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:19.713362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:19.713824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:19.714664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:19.715158 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:19.937666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:19.947303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4940b1b8-3685-44cc-be79-fdf0c12b2444 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.246124 Apr 20 19:32:19.947927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 290/519] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:19 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:19.952769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:19.953243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:19.961286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:19.961802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:19.962664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:19.963162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:20.039067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:20.039658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:20.040264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:20.051959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07642bda-70bc-43e7-803d-3bfbd04a9495 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "POST /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.709735 Apr 20 19:32:20.052641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 230/520] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:32:06 2021] POST /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73/os-volume_attachments => generated 194 bytes in 13712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:20.106755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:20.116358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-59cd4076-57d4-476c-ad5e-43e18d5fa844 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 200 len: 1308 microversion: 2.1 time: 0.167370 Apr 20 19:32:20.117394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 291/521] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:19 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:20.720257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:20.721136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:20.729902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:20.730410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:20.731264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:20.731755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:20.954842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:20.965945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:20.966608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:20.975379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:20.976199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:20.976540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:20.977097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:20.977732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:20.978239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:20.979628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ff57f9b-ef1c-4320-acf7-6fde63ed7035 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.263795 Apr 20 19:32:20.980357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 231/522] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:20 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:21.134310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:21.134961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:21.143314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:21.143947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:21.144782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:21.145153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:21.211987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:21.223058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] HTTP exception thrown: Instance 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d could not be found. Apr 20 19:32:21.223735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Returning 404 to user: Instance 0e2a7a38-b159-42bc-8b4a-e137ac5ea64d could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:21.224636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-46f7de6b-23bb-4e72-970f-46c09c7c3bf4 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d" status: 404 len: 111 microversion: 2.1 time: 0.094412 Apr 20 19:32:21.225050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2623ff5f-c231-434e-8308-b18db2fd5405 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.262886 Apr 20 19:32:21.225485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 232/523] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:21 2021] GET /compute/v2.1/servers/0e2a7a38-b159-42bc-8b4a-e137ac5ea64d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:21.225675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 292/524] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:20 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:21.236688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:21.237356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:21.245743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:21.246327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:21.248113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:21.248684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:21.316495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:32:21.435841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2f5801af-e5c4-4c95-a1af-a52fd1a06b42 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "DELETE /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 204 len: 0 microversion: 2.1 time: 0.205067 Apr 20 19:32:21.436782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 233/525] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:32:21 2021] DELETE /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:32:21.446542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:21.447217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:21.456150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:21.456790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:21.457654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:21.458158 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:21.677866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:21.686732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b4ac52de-9ad8-4b8d-ae77-be0682e6368b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1514 microversion: 2.1 time: 0.245044 Apr 20 19:32:21.687351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 293/526] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:21 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:22.000628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:22.001545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:22.009483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:22.010051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:22.010916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:22.011407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:22.230364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:22.240361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:22.242050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:22.243004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:22.243267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-df329fb7-805c-476c-8421-45ed481deff1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.247345 Apr 20 19:32:22.243684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:22.243853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 234/527] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:21 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:22.252402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:22.252920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:22.253777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:22.254280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:22.472053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:22.481762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5d71923f-dcd3-4d3d-89f0-41761387a367 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.242788 Apr 20 19:32:22.482387 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 294/528] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:22 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:22.706231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:22.706914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:22.714924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:22.715418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:22.716256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:22.716770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:22.934829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:22.944648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f533854-f0b6-4bec-95c3-fb2d366bf1c3 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1514 microversion: 2.1 time: 0.242602 Apr 20 19:32:22.945312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 235/529] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:22 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:23.263079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:23.263760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:23.272000 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:23.272512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:23.273371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:23.273861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:23.499735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:23.500449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:23.508473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:23.509035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:23.509878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:23.510406 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:23.541005 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:23.551499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:23.553352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:23.555147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a0f4ebbb-17ab-4f4a-accc-8259756bfddb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.296003 Apr 20 19:32:23.555919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 295/530] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:23 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:23.963805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:23.964493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:23.970073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:23.972612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:23.973169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:23.974020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:23.974801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:23.980393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-16dd2194-7d26-4ff9-8f28-cf950b52b41c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.484658 Apr 20 19:32:23.990588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 236/531] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:23 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:24.480664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:24.491918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-217909e4-d143-48ed-9b25-06bad4b4102b tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 200 len: 1514 microversion: 2.1 time: 0.532064 Apr 20 19:32:24.502327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 296/532] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:23 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 1514 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:24.575200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:24.576062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:24.585690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:24.586635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:24.588033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:24.588987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:24.599120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-83459461-38e9-40d2-864e-0fb0efc22623 req-68f0247c-89f9-4294-8073-b731e3bc6022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bfed580-15db-4f05-a50f-cb8fbfad6b39", "name": "network-vif-deleted", "tag": "e7c3b303-1f91-4666-9c18-e7c69424a700"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:24.600936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:24.600936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:32:24.610110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-83459461-38e9-40d2-864e-0fb0efc22623 req-68f0247c-89f9-4294-8073-b731e3bc6022 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:24.611030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-83459461-38e9-40d2-864e-0fb0efc22623 req-68f0247c-89f9-4294-8073-b731e3bc6022 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:24.636542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-83459461-38e9-40d2-864e-0fb0efc22623 req-68f0247c-89f9-4294-8073-b731e3bc6022 service nova] Creating event network-vif-deleted:e7c3b303-1f91-4666-9c18-e7c69424a700 for instance 1bfed580-15db-4f05-a50f-cb8fbfad6b39 on hv-cinder-78726 Apr 20 19:32:24.642241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-83459461-38e9-40d2-864e-0fb0efc22623 req-68f0247c-89f9-4294-8073-b731e3bc6022 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047348 Apr 20 19:32:24.643313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 297/533] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:32:24.827537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:24.838569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:24.840245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:24.841509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c8be95c4-40b2-4c6a-8d65-3635c4d46a14 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.270361 Apr 20 19:32:24.842126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 237/534] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:24 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:24.999220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:25.000054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:25.008753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:25.009111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:25.009966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:25.010455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:25.237418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:25.247547 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d2a0ed90-8f80-4e13-b152-664623fbd264 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.252741 Apr 20 19:32:25.248211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 298/535] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:24 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:25.510299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:25.511016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: 1bfed580-15db-4f05-a50f-cb8fbfad6b39] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:25.520289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:25.520861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:25.522002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:25.522596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:25.585599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] HTTP exception thrown: Instance 1bfed580-15db-4f05-a50f-cb8fbfad6b39 could not be found. Apr 20 19:32:25.586202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Returning 404 to user: Instance 1bfed580-15db-4f05-a50f-cb8fbfad6b39 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:25.587103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72184e63-2fd7-424b-b109-96c236c54e01 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39" status: 404 len: 111 microversion: 2.1 time: 0.080901 Apr 20 19:32:25.587709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 238/536] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:25 2021] GET /compute/v2.1/servers/1bfed580-15db-4f05-a50f-cb8fbfad6b39 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:25.862332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:25.862927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:25.870739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:25.871246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:25.872078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:25.872571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:26.092685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:26.105692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:26.107357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:26.108635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-da02f813-fe31-458d-b0ec-32ab1849555f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.251221 Apr 20 19:32:26.109295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 299/537] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:25 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:26.268800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:26.269491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:26.277456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:26.277966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:26.278822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:26.279320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:26.544565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:26.556349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-455eaa4d-792f-4b25-8dd8-15df5b23d66f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.294540 Apr 20 19:32:26.557039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 239/538] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:26 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:26.836825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:26.837390 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:26.845894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:26.846404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:26.847252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:26.847757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:26.917952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:32:27.045410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0429da1-7b66-43ac-a939-21a978106397 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "DELETE /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 204 len: 0 microversion: 2.1 time: 0.212261 Apr 20 19:32:27.046110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 300/539] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:32:26 2021] DELETE /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:32:27.055343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:27.056116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:27.065628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:27.066233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:27.067354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:27.067896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:27.129047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:27.129831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:27.138099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:27.138853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:27.139831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:27.140316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:27.406797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:27.426407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-465c15a0-ab35-45c5-a473-a4806cb972c0 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1514 microversion: 2.1 time: 0.374930 Apr 20 19:32:27.427136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 240/540] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:27 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1514 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:27.466508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:27.477489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:27.479270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:27.480508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad2b9e5d-33e6-4dec-b6ca-83b50412fcfe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.356133 Apr 20 19:32:27.481180 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 301/541] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:27 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:27.579553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:27.580459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:27.588302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:27.588878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:27.589733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:27.590236 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:27.804676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:27.815316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-220cca6c-5d8c-47c7-9bb3-fe5592564347 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.240124 Apr 20 19:32:27.815934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 241/542] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:27 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:28.445869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:28.446666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:28.455518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.456094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.456976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.458232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.500913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:28.502894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:28.510618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.511117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.511968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.512505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.799350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:28.805829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:28.808210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88e8c478-6433-47d9-941c-e0f21aec1a74 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1514 microversion: 2.1 time: 0.366389 Apr 20 19:32:28.810490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 302/543] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:28 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:28.817720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:28.819388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:28.820607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-142a6bfd-94b8-47b1-9a4b-81f8d12f3643 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.323876 Apr 20 19:32:28.821244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 242/544] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:28 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:28.833345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:28.834018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:28.841905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.842415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:28.843250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:28.843750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:29.060127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:29.070276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6169dfc7-89c8-42c1-9426-759c2af26ba2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.240971 Apr 20 19:32:29.070894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 303/545] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:28 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:29.826711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:29.827379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:29.836141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:29.836643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:29.837504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:29.837993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:29.839457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:29.840140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:29.848560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:29.849097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:29.849941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:29.850445 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:30.163809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:30.166609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:30.172612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f3621361-3a56-41c5-a92c-72e4fe2c18dd tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1514 microversion: 2.1 time: 0.349910 Apr 20 19:32:30.173897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 243/546] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:29 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:30.177430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:30.178786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:30.179161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:30.179460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:30.180397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-267b4927-c92f-4abf-8c9f-3264980f81df tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.344973 Apr 20 19:32:30.181186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 304/547] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:29 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:30.187151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:30.187630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:30.188471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:30.189105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:30.402251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:30.412563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-62d6acdc-bc8d-4c50-a9bf-58ccf6d93bb0 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.237636 Apr 20 19:32:30.413214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 244/548] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:30 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:31.100388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:32:31.100991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:32:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:32:31.191677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:31.192349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:31.199709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:31.200385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:31.201133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.201735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.202630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.203135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.208475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.209042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.209883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.210378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.751817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:31.756287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:31.760942 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c1d2071-9a3c-4a7b-b2c0-40a08de078b9 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1514 microversion: 2.1 time: 0.573714 Apr 20 19:32:31.761601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 305/549] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:31 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1514 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:31.766299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:31.767174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:31.767479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:31.769001 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:31.770234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c254dcc-31ea-412b-9ac5-c31064df7cb6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.574741 Apr 20 19:32:31.770816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 245/550] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:31 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:31.775609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.775609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.776392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:31.776945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:31.991647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:32.001421 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9a77052c-433a-4424-9c3a-e966147af5ce tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.238618 Apr 20 19:32:32.001975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 306/551] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:31 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:32.779723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:32.780737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:32.795709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:32.795937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:32.796381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:32.797189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:32.797653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:32.799111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:32.806455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:32.807206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:32.808281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:32.809026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:33.021980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:33.031068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ba0fc61-5505-4e26-82b5-903362fcea51 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1472 microversion: 2.1 time: 0.255440 Apr 20 19:32:33.031721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 246/552] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:32 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:33.037602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-f23a8f0e-7403-48be-a189-77cfe844cfd4 req-f55b7b93-a03a-4c91-9c9d-4f6e520897a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09", "name": "network-vif-deleted", "tag": "cdd9c1d0-c0d8-48c5-adc9-0e30b378e2ca"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:33.039629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:33.039629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:32:33.049452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f23a8f0e-7403-48be-a189-77cfe844cfd4 req-f55b7b93-a03a-4c91-9c9d-4f6e520897a1 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:33.049956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f23a8f0e-7403-48be-a189-77cfe844cfd4 req-f55b7b93-a03a-4c91-9c9d-4f6e520897a1 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:33.067627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-f23a8f0e-7403-48be-a189-77cfe844cfd4 req-f55b7b93-a03a-4c91-9c9d-4f6e520897a1 service nova] Creating event network-vif-deleted:cdd9c1d0-c0d8-48c5-adc9-0e30b378e2ca for instance a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 on hv-cinder-78726 Apr 20 19:32:33.072905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-f23a8f0e-7403-48be-a189-77cfe844cfd4 req-f55b7b93-a03a-4c91-9c9d-4f6e520897a1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039122 Apr 20 19:32:33.073552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 247/553] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:33.078882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:33.079720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:33.087796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:33.088317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:33.089200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:33.089699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:33.109988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:33.120861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:33.122533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:33.123768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f7d954b-3be7-4897-9bf1-09ee78024881 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.338405 Apr 20 19:32:33.124394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 307/554] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:32 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:33.308259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:33.317731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-705c0450-d9fd-441d-9129-4408686ef07a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.242986 Apr 20 19:32:33.318350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 248/555] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:33 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:34.052131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:34.052832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:34.060829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:34.061345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:34.062184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:34.062678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:34.144459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:34.145183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:34.153126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:34.153641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:34.154493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:34.155014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:34.192558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:34.201423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2c21f568-851e-4450-8a70-dd4dc2f2b30e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1472 microversion: 2.1 time: 0.153734 Apr 20 19:32:34.202056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 308/556] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:34 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:34.336609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:34.337442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:34.345878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:34.346466 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:34.347339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:34.347833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:34.371418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:34.382310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:34.383990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:34.385461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72d5095a-d189-407d-93a9-e430ec8ac4e0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.245987 Apr 20 19:32:34.386100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 249/557] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:34 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:34.569267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:34.578620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dd1a304e-1876-41ce-860c-cdfd17756d13 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.246101 Apr 20 19:32:34.579807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 309/558] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:34 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:35.221042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:35.221711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:35.229750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:35.230255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:35.231088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:35.231583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:35.406143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:35.406827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:35.416283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:35.416838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:35.417705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:35.418211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:35.498435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:35.507839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44d666b3-178c-49d7-b445-6eec6726e84e tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1303 microversion: 2.1 time: 0.291476 Apr 20 19:32:35.508456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 250/559] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:35 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:35.597935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:35.598618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:35.606607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:35.607157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:35.608007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:35.608508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:35.636692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:35.647792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:35.649534 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:35.650776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6f6dcf77-631a-4d63-bf52-59ebc3270638 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.249061 Apr 20 19:32:35.651383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 310/560] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:35 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:35.821936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:35.832265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6001bb2-af2c-4b4f-8966-7db7a19e4393 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.239158 Apr 20 19:32:35.832914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 251/561] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:35 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:36.207304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-2b8b0ef8-901f-4b08-982e-a60abe6cd487 req-c3d0554e-3faf-479f-a2dc-18dba5f97131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca897f-86b0-4162-a72d-2a399eef0f34", "name": "network-vif-plugged", "status": "completed", "tag": "22a8b0f9-0716-4893-9db4-55b6fdf5988e"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:36.209265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:36.209265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:32:36.218318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2b8b0ef8-901f-4b08-982e-a60abe6cd487 req-c3d0554e-3faf-479f-a2dc-18dba5f97131 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.218825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-2b8b0ef8-901f-4b08-982e-a60abe6cd487 req-c3d0554e-3faf-479f-a2dc-18dba5f97131 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.237879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-2b8b0ef8-901f-4b08-982e-a60abe6cd487 req-c3d0554e-3faf-479f-a2dc-18dba5f97131 service nova] Creating event network-vif-plugged:22a8b0f9-0716-4893-9db4-55b6fdf5988e for instance 75ca897f-86b0-4162-a72d-2a399eef0f34 on hv-cinder-78726 Apr 20 19:32:36.242931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-2b8b0ef8-901f-4b08-982e-a60abe6cd487 req-c3d0554e-3faf-479f-a2dc-18dba5f97131 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040849 Apr 20 19:32:36.243577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 311/562] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:32:36.526977 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:36.527662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:36.535926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.536442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.537319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.537823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.614663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.615097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.615621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lazy-loading 'fault' on Instance uuid a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:36.672354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:36.673803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:36.682127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.682651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.683504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.683898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2a4b1c9ccc4943bc354e2702f6db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360d38b62ef6436f887341a67ecd69b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:36.684026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.692820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0811e72f-a97b-4375-b64d-948eac442ddf tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 200 len: 1308 microversion: 2.1 time: 0.170030 Apr 20 19:32:36.693443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 252/563] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:36 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:36.853948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:36.854629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:36.863616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.864168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.874036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:36.874271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:36.905128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:36.916656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:36.918532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:36.919787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0995f9fe-d358-4d6e-aab7-020b20f1d3ae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.252074 Apr 20 19:32:36.920403 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 312/564] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:36 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:32:37.118615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:37.143610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d17446b6-5102-40f9-bfb5-f4607327cf05 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.293552 Apr 20 19:32:37.152777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 253/565] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:36 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:37.711445 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:37.712125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] [instance: a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:37.721045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.721515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.722366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.722868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.776556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] HTTP exception thrown: Instance a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 could not be found. Apr 20 19:32:37.777255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] Returning 404 to user: Instance a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:37.778151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-951f6f22-6c24-4c8c-88aa-939240904f44 tempest-AttachVolumeNegativeTest-836207938 tempest-AttachVolumeNegativeTest-836207938-project] 10.222.0.38 "GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09" status: 404 len: 111 microversion: 2.1 time: 0.070959 Apr 20 19:32:37.778753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 313/566] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:37 2021] GET /compute/v2.1/servers/a6b7e96a-cd56-45e6-88a6-7ba78bd1fe09 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:37.940264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:37.941366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:37.949230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.949738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:37.950618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:37.951068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:38.166219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:38.166914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:38.175185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:38.175692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:38.176760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:38.177232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:38.402008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:38.414010 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:38.416117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:38.417889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88021fdd-1025-4629-b4be-4b6454bbca8b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.481534 Apr 20 19:32:38.418542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 254/567] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:37 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:38.550678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:38.560931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-653692bc-a6b9-4d26-8b4b-e3787c04023e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.398646 Apr 20 19:32:38.561841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 314/568] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:38 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:39.450225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:39.450971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:39.459730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:39.460238 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:39.461112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:39.461606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:39.582767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:39.583519 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:39.592105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:39.592624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:39.593498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:39.594038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:39.737129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:39.748728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:39.749515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:39.751663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-958f211d-3f6e-497c-a551-d0e9995e0eae tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.305611 Apr 20 19:32:39.752389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 255/569] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:39 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:39.832245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:39.841753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-832ad619-f754-436c-b988-523d140e68ff tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1567 microversion: 2.1 time: 0.265343 Apr 20 19:32:39.842385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 315/570] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:39 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:40.773546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:40.775536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:40.787347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:40.787995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:40.789006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:40.789637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:40.862163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:40.863245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:40.874533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:40.875154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:40.876446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:40.877058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.104817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:41.116202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:41.118208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:41.119761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eed5dce6-6a39-476d-9cd3-bbdfd0e55272 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.351467 Apr 20 19:32:41.121446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 256/571] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:40 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:41.152364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:41.162946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e6875b11-0fa0-462b-a86a-e60b6fcb0cf2 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1547 microversion: 2.1 time: 0.306438 Apr 20 19:32:41.163579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 316/572] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:40 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1547 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:32:41.181230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:41.181786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:41.190333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.190849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.191704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.192202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.376063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] HTTP exception thrown: Cannot 'detach_volume' instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de while it is in vm_state rescued Apr 20 19:32:41.377226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Returning 409 to user: Cannot 'detach_volume' instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de while it is in vm_state rescued {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:41.378345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-47c88de1-39e1-4c70-b918-d0749c76d954 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments/75d87cd5-389f-475a-8913-f35731454737" status: 409 len: 152 microversion: 2.1 time: 0.201577 Apr 20 19:32:41.379146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 257/573] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:32:41 2021] DELETE /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments/75d87cd5-389f-475a-8913-f35731454737 => generated 152 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 19:32:41.388584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb37af91-e541-4438-81f4-46b71146f9d3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:41.389239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb37af91-e541-4438-81f4-46b71146f9d3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:41.398794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb37af91-e541-4438-81f4-46b71146f9d3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.401498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb37af91-e541-4438-81f4-46b71146f9d3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.403793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb37af91-e541-4438-81f4-46b71146f9d3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.405292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb37af91-e541-4438-81f4-46b71146f9d3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.571011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb37af91-e541-4438-81f4-46b71146f9d3 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action" status: 202 len: 0 microversion: 2.1 time: 0.182557 Apr 20 19:32:41.571011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 317/574] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:32:41 2021] POST /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:32:41.576553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:41.577980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:41.601556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.605411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.607990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:41.608507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:41.999377 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:42.009580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7d34f76c-52c1-4e02-a5d7-5cd614000999 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1555 microversion: 2.1 time: 0.436918 Apr 20 19:32:42.017491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 258/575] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:41 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1555 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:42.142316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:42.144139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:42.152829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:42.153351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:42.154210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:42.154760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:42.886335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:42.897884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:42.899720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:42.900986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c0af46bb-96ea-46d9-96ba-35d1168a959d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1807 microversion: 2.20 time: 0.765027 Apr 20 19:32:42.909415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 318/576] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:42 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1807 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:43.029421 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:43.030268 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:43.038808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:43.039373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:43.040292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:43.040821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:43.266110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:43.277713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d981b7f4-6fe2-44e5-84d5-a7704fdf1d7e tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1555 microversion: 2.1 time: 0.252210 Apr 20 19:32:43.278609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 259/577] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:43 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:43.921779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:43.922458 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:43.930497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:43.931015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:43.931915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:43.932411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:44.213118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:44.224030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:44.225746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:44.227033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-58875ac0-1549-4392-b338-eba931815b43 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1794 microversion: 2.20 time: 0.310218 Apr 20 19:32:44.227653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 319/578] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:32:43 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1794 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:32:44.298755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:44.299891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:44.308121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:44.309060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:44.309937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:44.310452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:44.539720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:44.549343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d5799b2d-4a93-4f60-94b1-8b8f5b57d70b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1555 microversion: 2.1 time: 0.255988 Apr 20 19:32:44.549973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 260/579] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:44 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:44.984195 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:44.984763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:44.993229 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:44.993736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:44.994558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:44.995213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:45.178569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lazy-loading 'services' on Instance uuid 44a715ab-1351-439b-a1a8-4c8ad9fc2a73 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:45.324193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fdd6b76c-9009-41b4-adbf-74b7c9cecb29 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "DELETE /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73/os-volume_attachments/1d296a6c-1399-4f6b-9185-39bc868b9cd0" status: 202 len: 0 microversion: 2.1 time: 0.344618 Apr 20 19:32:45.325551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 320/580] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:32:44 2021] DELETE /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73/os-volume_attachments/1d296a6c-1399-4f6b-9185-39bc868b9cd0 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:32:45.568159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:45.568868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:45.576735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:45.577268 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:45.578107 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:45.578611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:45.807648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:45.817361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fb2018e4-8b9d-4d92-a1c2-333adfa19537 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1561 microversion: 2.1 time: 0.253910 Apr 20 19:32:45.817970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 261/581] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:45 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1561 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:45.938005 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:45.938662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:45.946960 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:45.947466 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:45.948311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:45.948831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:46.128927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lazy-loading 'services' on Instance uuid c9c99e67-a6e2-4f90-bb81-d4e3f368f1de {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:32:46.404319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7bcf01af-5a14-420a-b37a-d0cdbe3861f6 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments/75d87cd5-389f-475a-8913-f35731454737" status: 202 len: 0 microversion: 2.1 time: 0.470685 Apr 20 19:32:46.405219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 321/582] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:32:45 2021] DELETE /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de/os-volume_attachments/75d87cd5-389f-475a-8913-f35731454737 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:32:46.633182 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:46.633992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:46.643233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:46.643938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:46.645237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:46.645885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:46.716246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:32:46.836358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02432e9f-1da6-4d28-b494-d978635099ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "DELETE /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 204 len: 0 microversion: 2.1 time: 0.206875 Apr 20 19:32:46.837093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 262/583] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:32:46 2021] DELETE /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:32:46.846550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:46.847340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:46.855537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:46.856003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:46.856878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:46.857376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:47.084648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:47.093446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4945a3c2-c084-41b2-816b-a56570558ead tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1514 microversion: 2.1 time: 0.251588 Apr 20 19:32:47.094075 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 322/584] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:46 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:48.113628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:48.114425 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:48.123449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:48.123956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:48.124831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:48.125325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:48.353736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:48.363245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f349e9f0-f098-4c8c-a5bb-95b680e2ea4b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1514 microversion: 2.1 time: 0.254523 Apr 20 19:32:48.363865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 263/585] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:48 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:49.381906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:49.382587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:49.391504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:49.392162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:49.393144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:49.393645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:49.930762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:49.940064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d8495bc1-9a1a-4b99-b202-4f9961c225ff tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 200 len: 1514 microversion: 2.1 time: 0.562207 Apr 20 19:32:49.940679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 323/586] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:49 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 1514 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:50.197373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-25527f7e-2c13-4c58-94e1-872816e6fb43 req-41afe4bb-3d22-4f19-8b88-49873083993a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a715ab-1351-439b-a1a8-4c8ad9fc2a73", "name": "network-vif-deleted", "tag": "84830ef0-3a32-4ca9-88c2-b9876108356b"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:32:50.199849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:32:50.199849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:32:50.211230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-25527f7e-2c13-4c58-94e1-872816e6fb43 req-41afe4bb-3d22-4f19-8b88-49873083993a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:50.211788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-25527f7e-2c13-4c58-94e1-872816e6fb43 req-41afe4bb-3d22-4f19-8b88-49873083993a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:50.229928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-25527f7e-2c13-4c58-94e1-872816e6fb43 req-41afe4bb-3d22-4f19-8b88-49873083993a service nova] Creating event network-vif-deleted:84830ef0-3a32-4ca9-88c2-b9876108356b for instance 44a715ab-1351-439b-a1a8-4c8ad9fc2a73 on hv-cinder-78726 Apr 20 19:32:50.235023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-25527f7e-2c13-4c58-94e1-872816e6fb43 req-41afe4bb-3d22-4f19-8b88-49873083993a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041988 Apr 20 19:32:50.235866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 264/587] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:32:50.959267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:50.959943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: 44a715ab-1351-439b-a1a8-4c8ad9fc2a73] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:50.967922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:50.968453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:50.969824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:50.970332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:51.024376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] HTTP exception thrown: Instance 44a715ab-1351-439b-a1a8-4c8ad9fc2a73 could not be found. Apr 20 19:32:51.025094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Returning 404 to user: Instance 44a715ab-1351-439b-a1a8-4c8ad9fc2a73 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:32:51.025991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f6bb34f-d4ea-40c8-920a-8b59e435dae9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73" status: 404 len: 111 microversion: 2.1 time: 0.070888 Apr 20 19:32:51.029297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 324/588] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:50 2021] GET /compute/v2.1/servers/44a715ab-1351-439b-a1a8-4c8ad9fc2a73 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:32:51.360290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:51.361030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:51.369796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:51.370307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:51.371152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:51.371860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:51.441649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:32:51.558668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-65d9aaa0-e3a5-4618-9199-fc3a293ed94c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 204 len: 0 microversion: 2.1 time: 0.202921 Apr 20 19:32:51.559367 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 265/589] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:32:51 2021] DELETE /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:32:51.568143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:51.568958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:51.576905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:51.577415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:51.578251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:51.579252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:51.800905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:51.812390 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2959a739-9456-4ae9-a068-7e92d4ebeb4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.248222 Apr 20 19:32:51.813790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 325/590] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:51 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:52.834563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:52.835333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:52.843160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:52.843664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:52.845198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:52.845697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:53.067320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:53.076222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fcb98b26-65e3-4967-b91c-979a7382f1f7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.246384 Apr 20 19:32:53.076870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 266/591] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:52 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:54.094147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:54.095320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:54.103389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:54.103900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:54.104816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:54.105319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:54.324144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:54.333877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-73ad3692-bde5-44ef-8657-e04aa393e67f tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.243928 Apr 20 19:32:54.334503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 326/592] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:54 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:55.352127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:55.352738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:55.361314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:55.361816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:55.362663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:55.363165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:55.585431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:55.594856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c52a824-894e-4deb-a69a-17d491513150 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.246459 Apr 20 19:32:55.595633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 267/593] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:55 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:56.613766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:56.614430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:56.622279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:56.622788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:56.623622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:56.624117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:56.842099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:56.852111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7647d49d-1473-4b2d-b773-d33b921a8a4a tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.243247 Apr 20 19:32:56.852920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 327/594] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:56 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:57.871261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:57.871932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:57.880271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:57.880808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:57.881648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:57.882141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:58.101419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:58.110718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6f4458cf-44ea-410b-b3b3-6211442ccb1b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.243558 Apr 20 19:32:58.111343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 268/595] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:57 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:32:59.128971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:32:59.129571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:32:59.137618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:59.138127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:59.138963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:32:59.139457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:32:59.355013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:32:59.366327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9bfe2d02-fb65-4f92-aaa6-caecd285b0e7 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.241202 Apr 20 19:32:59.366513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 328/596] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:32:59 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:00.383783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:00.384470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:00.392318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:00.392870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:00.393731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:00.394228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:00.458467 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:00.459031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:00.471551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:00.471551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:00.471939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:00.472447 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:00.655349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lazy-loading 'services' on Instance uuid d9ed4913-e7ef-455c-9061-477f1274e3b7 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:33:00.807854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ebc40e93-4bff-4036-ad24-21cf4d45d451 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/os-volume_attachments/d22da28a-6782-4f2a-a323-3fd262e4db33" status: 202 len: 0 microversion: 2.1 time: 0.352880 Apr 20 19:33:00.808931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 329/597] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:33:00 2021] DELETE /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/os-volume_attachments/d22da28a-6782-4f2a-a323-3fd262e4db33 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:33:01.173129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:01.183004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a5b53af8-8817-45b9-bafb-c55c18428424 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1507 microversion: 2.1 time: 0.803255 Apr 20 19:33:01.183639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 269/598] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:00 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1507 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:01.467631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-712257643", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "9ab6c281-68b5-4ebd-9d5b-ff1c3d42a6de"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:01.472925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-b2e11125-6f4c-44ec-93fc-7aef1fa928cc req-0613bd00-b9ce-4def-9777-df8f8a6c5cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c66822-12bf-4406-b7d7-8da089316106", "name": "network-vif-deleted", "tag": "8b80eb18-b82a-4b8e-a9d4-1f24cd0c8a5a"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:01.474676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:01.474676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:01.488557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b2e11125-6f4c-44ec-93fc-7aef1fa928cc req-0613bd00-b9ce-4def-9777-df8f8a6c5cfb service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:01.488672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b2e11125-6f4c-44ec-93fc-7aef1fa928cc req-0613bd00-b9ce-4def-9777-df8f8a6c5cfb service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:01.511863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-b2e11125-6f4c-44ec-93fc-7aef1fa928cc req-0613bd00-b9ce-4def-9777-df8f8a6c5cfb service nova] Creating event network-vif-deleted:8b80eb18-b82a-4b8e-a9d4-1f24cd0c8a5a for instance b5c66822-12bf-4406-b7d7-8da089316106 on hv-cinder-78726 Apr 20 19:33:01.518096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-b2e11125-6f4c-44ec-93fc-7aef1fa928cc req-0613bd00-b9ce-4def-9777-df8f8a6c5cfb service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049846 Apr 20 19:33:01.519408 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 270/599] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:01.595754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] validate_networks() for [('9ab6c281-68b5-4ebd-9d5b-ff1c3d42a6de', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:33:02.164105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:33:02.164581 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:33:02.165243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:33:02.165761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:33:02.166225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:33:02.175622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:02.176128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:02.177064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:02.177879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:02.198204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Getting quotas for project a57e6ed91f174567963cdeb0df5ab371. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:33:02.203177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:02.204391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Getting quotas for user ff879400ac734b22998db346bfc74242 and project a57e6ed91f174567963cdeb0df5ab371. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:33:02.204741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:02.217159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:02.217325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:33:02.217667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:02.218522 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:02.219065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:02.220278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:33:02.275865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ac1b2f08-5110-4d99-8a33-4dd458e2ad59 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813193 Apr 20 19:33:02.277111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 330/600] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:33:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:33:02.288752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab9a76b6-eba4-424a-a8dd-45fef7f0edd9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:02.289491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab9a76b6-eba4-424a-a8dd-45fef7f0edd9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:02.299535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:02.300012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:02.300661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lazy-loading 'fault' on Instance uuid b5c66822-12bf-4406-b7d7-8da089316106 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:33:02.437351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:02.446078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2b4d35a8-1c42-4782-8439-e92b00689f2d tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 200 len: 1312 microversion: 2.1 time: 0.247749 Apr 20 19:33:02.446719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 271/601] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:02 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:33:02.457025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ab9a76b6-eba4-424a-a8dd-45fef7f0edd9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:02.465696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab9a76b6-eba4-424a-a8dd-45fef7f0edd9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1218 microversion: 2.1 time: 0.181210 Apr 20 19:33:02.466515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 331/602] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:02 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:03.148159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44663fe4-570d-4dc7-a30f-aa22ae223aaa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:03.156963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44663fe4-570d-4dc7-a30f-aa22ae223aaa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.157947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44663fe4-570d-4dc7-a30f-aa22ae223aaa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.218456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44663fe4-570d-4dc7-a30f-aa22ae223aaa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Going to try to stop instance {{(pid=100563) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 19:33:03.297769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44663fe4-570d-4dc7-a30f-aa22ae223aaa tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 202 len: 0 microversion: 2.1 time: 0.153552 Apr 20 19:33:03.298424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 272/603] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:33:03 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:33:03.307031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:03.307714 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:03.317432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.317989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.319065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.319560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.467482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:03.468340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: b5c66822-12bf-4406-b7d7-8da089316106] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:03.479287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.479832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.480639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.481160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.540177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] HTTP exception thrown: Instance b5c66822-12bf-4406-b7d7-8da089316106 could not be found. Apr 20 19:33:03.540982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Returning 404 to user: Instance b5c66822-12bf-4406-b7d7-8da089316106 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:03.541860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b9775921-860b-43f7-b5e8-6453dec4c807 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106" status: 404 len: 111 microversion: 2.1 time: 0.079231 Apr 20 19:33:03.545466 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 273/604] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:03 2021] GET /compute/v2.1/servers/b5c66822-12bf-4406-b7d7-8da089316106 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:33:03.547204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:03.547877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:03.551278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:03.556299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.556844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.557687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.558177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.560176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9f5025c5-3163-44cc-ad04-8eb412a00cc5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.257157 Apr 20 19:33:03.561138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 332/605] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:03 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:03.566255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:03.566883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:03.574754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.575339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.576260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.576860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.644586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:33:03.692110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:03.702028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e5080446-a612-4988-befb-1354fdb53fe5 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1278 microversion: 2.1 time: 0.158444 Apr 20 19:33:03.702966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 274/606] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:03 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:03.765421 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e79b5b7c-93b3-470a-9864-14c0155734db tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 204 len: 0 microversion: 2.1 time: 0.202513 Apr 20 19:33:03.767599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 333/607] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:33:03 2021] DELETE /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:33:03.776626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:03.777336 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:03.787570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.788081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:03.789006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:03.789452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:04.019537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:04.028631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b85ab77-0c39-44d2-a3e1-d02f28f4cb34 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.256871 Apr 20 19:33:04.029303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 275/608] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:03 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:04.579393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:04.580286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:04.588113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:04.588735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:04.589578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:04.590070 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:04.721418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:04.722092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:04.730343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:04.730906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:04.731882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:04.732386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:04.872103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:04.882368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f7b73236-93ae-49cd-9695-d74dfd2103de tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.307563 Apr 20 19:33:04.883275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 334/609] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:04 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:04.964417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:04.973558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5a44e39e-b136-4198-8545-8ced584203c3 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.256396 Apr 20 19:33:04.974204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 276/610] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:04 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:05.048069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:05.048726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:05.056605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:05.057150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:05.057996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:05.058494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:05.275222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:05.285262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9afde63a-1c13-4fa7-b158-bbba1dd97c8c tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.242034 Apr 20 19:33:05.285882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 335/611] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:05 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:05.687381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-cb97ba99-6dcc-4c43-bc31-c4bf6b35cf4f req-0dcb2748-d75f-412f-a68d-9f31ef361f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5ea3c1-a345-410c-8549-602f588efe60", "tag": "3eba2c99-33e0-4daa-9a9d-cfc9bbd89c6c"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:05.689339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:05.689339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:05.700570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-cb97ba99-6dcc-4c43-bc31-c4bf6b35cf4f req-0dcb2748-d75f-412f-a68d-9f31ef361f44 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:05.701098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-cb97ba99-6dcc-4c43-bc31-c4bf6b35cf4f req-0dcb2748-d75f-412f-a68d-9f31ef361f44 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:05.720678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-cb97ba99-6dcc-4c43-bc31-c4bf6b35cf4f req-0dcb2748-d75f-412f-a68d-9f31ef361f44 service nova] Creating event network-changed:3eba2c99-33e0-4daa-9a9d-cfc9bbd89c6c for instance ab5ea3c1-a345-410c-8549-602f588efe60 on hv-cinder-78726 Apr 20 19:33:05.726008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-cb97ba99-6dcc-4c43-bc31-c4bf6b35cf4f req-0dcb2748-d75f-412f-a68d-9f31ef361f44 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043771 Apr 20 19:33:05.727166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 277/612] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:05.901148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:05.901753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:05.910099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:05.910600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:05.911434 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:05.911925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:05.992400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:05.993207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:06.002079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:06.002588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:06.003435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:06.003944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:06.184760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:06.196572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a67608dc-ef20-4eaf-a9ea-d4d712a108a0 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.299105 Apr 20 19:33:06.197125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 336/613] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:05 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:06.269426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:06.278559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b23e2463-c0b6-4d28-94f6-26234a7f3f81 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.290638 Apr 20 19:33:06.279193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 278/614] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:05 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:33:06.303662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:06.304463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:06.312508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:06.313733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:06.314661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:06.315231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:06.543389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:06.553065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b7c29dee-8eda-430f-b90b-93981c18fc45 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.253422 Apr 20 19:33:06.553702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 337/615] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:06 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:07.214604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:07.215293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:07.223588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:07.224094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:07.224975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:07.225469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:07.297918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:07.298791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:07.306786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:07.307296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:07.308149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:07.308651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:07.493631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:07.503256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c2128f8-ba5a-486d-a38e-1a76606f61f9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.292721 Apr 20 19:33:07.503899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 279/616] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:07 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:07.571082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:07.571757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:07.577093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:07.582185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:07.582702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:07.583610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:07.584114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:07.586877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ab5d104-580e-47ea-a07e-386450ba195a tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.293748 Apr 20 19:33:07.587488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 338/617] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:07 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:33:07.793001 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:07.802491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5fd50fce-39a7-4821-a6df-7e93f8a6b385 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.235467 Apr 20 19:33:07.803123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 280/618] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:07 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:33:08.522158 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:08.522830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:08.530776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:08.531326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:08.533099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:08.533604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:08.605327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:08.605998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:08.614488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:08.614992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:08.615857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:08.616324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:08.818289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:08.827740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-637490bc-b513-4e7c-99e3-c98cbecdfc79 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.309498 Apr 20 19:33:08.828624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 339/619] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:08 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:08.841070 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:08.841898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:08.850939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:08.851535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:08.852456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:08.853013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:08.893774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:08.902800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f2e0fb6b-0002-45b4-8590-1470b201544d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.301571 Apr 20 19:33:08.903642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 281/620] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:08 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:33:09.073085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:09.082308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6876843e-d67b-4c6e-807a-9d4d39655077 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.252394 Apr 20 19:33:09.083051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 340/621] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:08 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:09.846723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:09.847394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:09.855247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:09.855756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:09.856610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:09.857147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:09.922004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:09.922652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:09.930902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:09.931062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:09.931904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:09.932393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:10.163741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:10.173567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e2721896-cd10-49f8-a446-d90c5846f59d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.331533 Apr 20 19:33:10.174132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 282/622] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:09 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:10.178854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:10.179521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:10.187019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:10.187536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:10.189092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:10.189588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:10.209898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:10.220122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3704d62c-b134-4528-9c71-7752a3c29c3b tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.301088 Apr 20 19:33:10.221296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 341/623] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:09 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:33:10.401912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:10.411934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4a54fcb3-d879-4d08-a48d-3202a4ea1b8b tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1521 microversion: 2.1 time: 0.236756 Apr 20 19:33:10.412743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 283/624] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:10 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:11.192053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:11.193774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:11.202256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:11.203020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:11.204882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:11.205243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:11.242420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:11.243325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:11.253594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:11.257839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:11.260528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:11.261697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:11.555379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:11.571367 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b6d4313-f7bf-45ec-905e-ef6db1dd8dbb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.383880 Apr 20 19:33:11.572562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 342/625] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:11 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:11.581745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:11.589989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:11.612158 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:11.612851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:11.613850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:11.614440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:11.674355 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:11.688643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2184ee9e-32d6-4b81-9bea-bb36612fa133 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.452136 Apr 20 19:33:11.689582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 284/626] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:11 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:11.759118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a9ef0958-251f-4e8d-81f2-ff5a183b1776 req-fb2f083b-aae9-46b5-8849-a7b73f07bf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9c99e67-a6e2-4f90-bb81-d4e3f368f1de", "name": "network-vif-deleted", "tag": "7dd320e4-5118-4b15-8942-5329b2b163c1"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:11.761651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:11.761651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:11.775681 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a9ef0958-251f-4e8d-81f2-ff5a183b1776 req-fb2f083b-aae9-46b5-8849-a7b73f07bf7f service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:11.776741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a9ef0958-251f-4e8d-81f2-ff5a183b1776 req-fb2f083b-aae9-46b5-8849-a7b73f07bf7f service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:11.784023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f84dbc0f2b457bb525c44c7564f9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a872b344d5e4785bc501bb382a739e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:11.794655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5e500d6d-ca50-4339-b818-98320b65d8cd tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 200 len: 1479 microversion: 2.1 time: 0.221074 Apr 20 19:33:11.795285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 343/627] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:11 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 1479 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:11.801214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a9ef0958-251f-4e8d-81f2-ff5a183b1776 req-fb2f083b-aae9-46b5-8849-a7b73f07bf7f service nova] Creating event network-vif-deleted:7dd320e4-5118-4b15-8942-5329b2b163c1 for instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de on hv-cinder-78726 Apr 20 19:33:11.810528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a9ef0958-251f-4e8d-81f2-ff5a183b1776 req-fb2f083b-aae9-46b5-8849-a7b73f07bf7f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055037 Apr 20 19:33:11.811391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 285/628] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:12.589422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:12.590168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:12.598949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:12.599464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:12.600319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:12.600871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:12.710309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:12.711567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:12.730767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:12.733804 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:12.734946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:12.737116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:13.097484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:13.107007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-46f70765-07d9-4a3f-9fe8-586ef333797e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.521565 Apr 20 19:33:13.107151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:13.107799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 344/629] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:12 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:13.113306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:13.113968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] [instance: c9c99e67-a6e2-4f90-bb81-d4e3f368f1de] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:13.121650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:13.122240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:13.123186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:13.123716 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:13.130254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3461ed01-2bec-4504-8794-a13f6d4da9e6 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.426432 Apr 20 19:33:13.130961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 286/630] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:12 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:13.145287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-893de514-677c-4a63-ac40-b2baca30efc6 req-074c5091-4df9-42fe-b733-f4f017a63783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5ea3c1-a345-410c-8549-602f588efe60", "name": "network-vif-plugged", "status": "completed", "tag": "3eba2c99-33e0-4daa-9a9d-cfc9bbd89c6c"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:13.147088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:13.147088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:13.155921 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-893de514-677c-4a63-ac40-b2baca30efc6 req-074c5091-4df9-42fe-b733-f4f017a63783 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:13.156490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-893de514-677c-4a63-ac40-b2baca30efc6 req-074c5091-4df9-42fe-b733-f4f017a63783 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:13.174696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-893de514-677c-4a63-ac40-b2baca30efc6 req-074c5091-4df9-42fe-b733-f4f017a63783 service nova] Creating event network-vif-plugged:3eba2c99-33e0-4daa-9a9d-cfc9bbd89c6c for instance ab5ea3c1-a345-410c-8549-602f588efe60 on hv-cinder-78726 Apr 20 19:33:13.180049 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-893de514-677c-4a63-ac40-b2baca30efc6 req-074c5091-4df9-42fe-b733-f4f017a63783 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041517 Apr 20 19:33:13.180786 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 287/631] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:13.185335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] HTTP exception thrown: Instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de could not be found. Apr 20 19:33:13.186022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] Returning 404 to user: Instance c9c99e67-a6e2-4f90-bb81-d4e3f368f1de could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:13.187262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-888323fe-ae84-4018-a6a6-151f25bae115 tempest-ServerRescueNegativeTestJSON-341494395 tempest-ServerRescueNegativeTestJSON-341494395-project] 10.222.0.38 "GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de" status: 404 len: 111 microversion: 2.1 time: 0.077968 Apr 20 19:33:13.188762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 345/632] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:13 2021] GET /compute/v2.1/servers/c9c99e67-a6e2-4f90-bb81-d4e3f368f1de => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:33:14.126276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:14.127699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:14.136159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:14.136851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:14.138432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:14.138859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:14.155298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:14.156919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:14.179193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:14.179933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:14.180985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:14.181775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:14.639874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:14.650260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4c8667e2-4460-44c2-9cbf-2c0fc575f080 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.528625 Apr 20 19:33:14.651412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 288/633] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:14 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:14.680801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:14.691783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07a1008e-bcb2-4f75-b986-fc18246e23c0 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1318 microversion: 2.1 time: 0.547199 Apr 20 19:33:14.692811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 346/634] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:14 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:15.669026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:15.669697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:15.678285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:15.678793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:15.679780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:15.680279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:15.710892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:15.711809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:15.721089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:15.721609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:15.722463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:15.723207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:16.425228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:16.435074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:16.445039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6aa1a0cb-c817-4eec-acc9-d9cb3c249868 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.779875 Apr 20 19:33:16.446526 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 289/635] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:15 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:16.454633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4496e693-1b0e-4c83-a4ad-abd6bdf3ab26 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1508 microversion: 2.1 time: 0.739788 Apr 20 19:33:16.455928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 347/636] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:15 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1508 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:16.474765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8910fd35-fe13-49f6-8f79-3c6b637d470c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ff2c5e9-3357-4432-a68a-851230a34d8e", "device": "/dev/sdb"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:16.476892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8910fd35-fe13-49f6-8f79-3c6b637d470c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:16.488743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8910fd35-fe13-49f6-8f79-3c6b637d470c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:16.489374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8910fd35-fe13-49f6-8f79-3c6b637d470c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:16.490311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8910fd35-fe13-49f6-8f79-3c6b637d470c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:16.490911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8910fd35-fe13-49f6-8f79-3c6b637d470c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:16.913253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8910fd35-fe13-49f6-8f79-3c6b637d470c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "POST /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444328 Apr 20 19:33:16.914511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 290/637] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:33:16 2021] POST /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:17.464114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:17.464882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:17.481540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:17.481976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:17.482887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:17.485995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:17.924175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:17.936699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-62ae7d2f-3235-4718-86e5-e9ea9fd22298 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.476871 Apr 20 19:33:17.937874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 348/638] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:17 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:18.956142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:18.957010 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:18.967449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:18.967965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:18.968833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:18.969644 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:19.338055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:19.355050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-101ea636-1e61-4ffd-801e-78649980973a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1675 microversion: 2.1 time: 0.403895 Apr 20 19:33:19.356315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 291/639] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:18 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1675 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:20.373289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:20.373963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:20.382220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:20.382731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:20.383776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:20.384274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:20.612042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:20.621056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ced2d43-fe91-459f-8679-446cab1cc1f6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1652 microversion: 2.1 time: 0.251848 Apr 20 19:33:20.621693 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 349/640] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:20 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1652 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:20.638370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-263b8b87-2380-4919-8370-9bd71fb93968 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:20.647489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-263b8b87-2380-4919-8370-9bd71fb93968 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:20.647928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-263b8b87-2380-4919-8370-9bd71fb93968 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:20.713715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-263b8b87-2380-4919-8370-9bd71fb93968 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Going to try to start instance {{(pid=100563) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 19:33:20.796991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-263b8b87-2380-4919-8370-9bd71fb93968 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action" status: 202 len: 0 microversion: 2.1 time: 0.162252 Apr 20 19:33:20.797653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 292/641] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:33:20 2021] POST /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:33:20.806174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:20.806841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:20.815066 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:20.815575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:20.816423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:20.816943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:21.052999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:21.067111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7d881dca-d9e5-4ea2-ace1-a65ba60ed853 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1661 microversion: 2.1 time: 0.264715 Apr 20 19:33:21.067943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 350/642] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:20 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1661 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:21.737565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-73fe1f76-757d-4f8f-bbc6-7bf3b8110d32 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Action: 'create', calling method: .version_select at 0x7f03952bbd08>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1467551247"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:22.085579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:22.086469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:22.094850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:22.095523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:22.096923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:22.097897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:22.209068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-73fe1f76-757d-4f8f-bbc6-7bf3b8110d32 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.612947 Apr 20 19:33:22.213542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 293/643] 10.222.0.38 () {60 vars in 1145 bytes} [Tue Apr 20 19:33:21 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 615 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 20 19:33:22.222126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b449cbc8-37ec-4b60-b414-119ecb15964b tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03940d2268>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:22.325071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b449cbc8-37ec-4b60-b414-119ecb15964b tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d" status: 200 len: 345 microversion: 2.1 time: 0.107071 Apr 20 19:33:22.325943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 294/644] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:33:22 2021] GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:22.356639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:22.366799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-afc88458-ad0e-4e9e-b67f-c081c7b140a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1661 microversion: 2.1 time: 0.285682 Apr 20 19:33:22.367561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 351/645] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:22 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1661 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:23.338956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e653f619-53c2-46aa-8af5-b87d19afad53 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03940d28c8>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:23.386463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:23.387071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:23.395114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:23.395631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:23.396486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:23.397013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:23.439776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e653f619-53c2-46aa-8af5-b87d19afad53 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d" status: 200 len: 346 microversion: 2.1 time: 0.104818 Apr 20 19:33:23.440396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 295/646] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:33:23 2021] GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:23.452600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b82bee52-4f9b-46ed-ab4a-03636beded7b tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Action: 'create', calling method: .version_select at 0x7f03940d2840>, body: {"snapshot": {"volume_id": "bb5aeb56-8ecd-4837-91f8-d178ad440e5d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-824766962"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:23.629625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:23.638762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-81f5e571-5058-4347-9c27-625eb77939b5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1665 microversion: 2.1 time: 0.256335 Apr 20 19:33:23.639329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 352/647] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:23 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1665 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:33:23.693941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b82bee52-4f9b-46ed-ab4a-03636beded7b tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.245385 Apr 20 19:33:23.694597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 296/648] 10.222.0.38 () {60 vars in 1152 bytes} [Tue Apr 20 19:33:23 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:23.705948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-21864bb3-1dac-4b0d-b530-3cec1517dab4 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03952c20d0>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:23.755713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-21864bb3-1dac-4b0d-b530-3cec1517dab4 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.054585 Apr 20 19:33:23.756444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 353/649] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:23 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:23.767511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e3f074cd-d0a1-4d8a-9668-255772aeb635 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f0387d97730>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:23.810396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e3f074cd-d0a1-4d8a-9668-255772aeb635 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.047782 Apr 20 19:33:23.811004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 297/650] 10.222.0.38 () {58 vars in 1130 bytes} [Tue Apr 20 19:33:23 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:23.822739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-99c8b173-65c2-476e-b21f-6890961c1979 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f0395bb49d8>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:23.883446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-99c8b173-65c2-476e-b21f-6890961c1979 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.064595 Apr 20 19:33:23.884205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 354/651] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:23 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:24.895516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1fae6f17-fcd6-4563-9a63-09293a612e0a tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03952bbae8>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:24.948656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1fae6f17-fcd6-4563-9a63-09293a612e0a tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.057025 Apr 20 19:33:24.949380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 298/652] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:24 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:25.964295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a4c0aa51-b082-40a4-bd74-6fae1ebf47ae tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03992bd0d0>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:26.017284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a4c0aa51-b082-40a4-bd74-6fae1ebf47ae tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.056999 Apr 20 19:33:26.017976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 355/653] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:25 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:27.033086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b187b449-a70b-4d19-9e24-4b7bb7428801 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03952bb6a8>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:27.044381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ffc76c01-04a5-403b-8567-da4f1f9692fb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:27.044997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ffc76c01-04a5-403b-8567-da4f1f9692fb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:27.053999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffc76c01-04a5-403b-8567-da4f1f9692fb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:27.054515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffc76c01-04a5-403b-8567-da4f1f9692fb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:27.055370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffc76c01-04a5-403b-8567-da4f1f9692fb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:27.055875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ffc76c01-04a5-403b-8567-da4f1f9692fb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:27.080420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b187b449-a70b-4d19-9e24-4b7bb7428801 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.052619 Apr 20 19:33:27.081082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 299/654] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:27 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:27.124417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ffc76c01-04a5-403b-8567-da4f1f9692fb tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-volume_attachments/d870da37-f83f-426f-8e93-be3986bde5e8" status: 200 len: 194 microversion: 2.20 time: 0.084280 Apr 20 19:33:27.125184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 356/655] 10.222.0.38 () {60 vars in 1444 bytes} [Tue Apr 20 19:33:27 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-volume_attachments/d870da37-f83f-426f-8e93-be3986bde5e8 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:33:27.237087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:27.237862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:27.246318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:27.246772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:27.247623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:27.248095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:27.421065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lazy-loading 'services' on Instance uuid 75ca897f-86b0-4162-a72d-2a399eef0f34 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:33:27.568892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f8d49f4d-ff40-4c57-b0c0-e7cc6204447c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-volume_attachments/d870da37-f83f-426f-8e93-be3986bde5e8" status: 202 len: 0 microversion: 2.20 time: 0.335776 Apr 20 19:33:27.569735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 300/656] 10.222.0.38 () {60 vars in 1447 bytes} [Tue Apr 20 19:33:27 2021] DELETE /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34/os-volume_attachments/d870da37-f83f-426f-8e93-be3986bde5e8 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:33:28.092921 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02fe28a0-2b9b-4bab-9c8f-5696dd5bfcf7 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03952c26a8>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:28.140250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02fe28a0-2b9b-4bab-9c8f-5696dd5bfcf7 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 287 microversion: 2.1 time: 0.051300 Apr 20 19:33:28.141046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 357/657] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:28 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:28.152452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88460e23-de31-4cee-8c3e-4809d184119b tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03940d2bf8>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:28.257527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88460e23-de31-4cee-8c3e-4809d184119b tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "DELETE /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 202 len: 0 microversion: 2.1 time: 0.109441 Apr 20 19:33:28.258153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 301/658] 10.222.0.38 () {58 vars in 1244 bytes} [Tue Apr 20 19:33:28 2021] DELETE /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:33:28.267147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-70b48627-ab03-45a6-9219-339d63c77c6e tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f0395bb4a60>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:28.314859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-70b48627-ab03-45a6-9219-339d63c77c6e tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.051416 Apr 20 19:33:28.316008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 358/659] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:28 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:29.327901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f4bf313a-26ca-40ca-a7b8-2bd78af8d870 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03940d2a60>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:29.376104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f4bf313a-26ca-40ca-a7b8-2bd78af8d870 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.052382 Apr 20 19:33:29.376737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 302/660] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:29 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:30.388435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ba80be9-2e21-41e4-b5bf-abf27d6c7458 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f039527eb70>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:30.436734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ba80be9-2e21-41e4-b5bf-abf27d6c7458 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 200 len: 286 microversion: 2.1 time: 0.052144 Apr 20 19:33:30.437965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 359/661] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:30 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:31.450674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-63c68cb1-2b92-499b-80ef-f62734cf480d tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03952bb950>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:31.506868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-63c68cb1-2b92-499b-80ef-f62734cf480d tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] HTTP exception thrown: Snapshot 51875f00-a133-450d-bdd2-a9fffaca70b5 could not be found. Apr 20 19:33:31.507549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-63c68cb1-2b92-499b-80ef-f62734cf480d tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Returning 404 to user: Snapshot 51875f00-a133-450d-bdd2-a9fffaca70b5 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:31.508452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-63c68cb1-2b92-499b-80ef-f62734cf480d tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5" status: 404 len: 111 microversion: 2.1 time: 0.062444 Apr 20 19:33:31.518032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb4d84ce-ebb5-4d70-a2fa-67cbf1752fd8 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f0395371378>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:31.525034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 303/662] 10.222.0.38 () {58 vars in 1241 bytes} [Tue Apr 20 19:33:31 2021] GET /compute/v2.1/os-snapshots/51875f00-a133-450d-bdd2-a9fffaca70b5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:33:31.638456 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb4d84ce-ebb5-4d70-a2fa-67cbf1752fd8 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d" status: 202 len: 0 microversion: 2.1 time: 0.124869 Apr 20 19:33:31.639120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 360/663] 10.222.0.38 () {58 vars in 1238 bytes} [Tue Apr 20 19:33:31 2021] DELETE /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:33:31.648563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1fa3e05e-b14f-4474-a854-ef5c80417a98 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03952bbe18>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:31.753947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1fa3e05e-b14f-4474-a854-ef5c80417a98 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d" status: 200 len: 345 microversion: 2.1 time: 0.109296 Apr 20 19:33:31.754657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 304/664] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:33:31 2021] GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:32.164119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:32.164672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:32.173989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:32.174618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:32.175550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:32.176045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:32.245932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:33:32.364328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3c33f8d1-9d2d-460c-a520-6103420a4896 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 204 len: 0 microversion: 2.20 time: 0.203971 Apr 20 19:33:32.365028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 361/665] 10.222.0.38 () {60 vars in 1270 bytes} [Tue Apr 20 19:33:32 2021] DELETE /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:33:32.373690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:32.374544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:32.383725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:32.384232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:32.385106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:32.385613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:32.604641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:32.614528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:32.616266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:32.617513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b6edf056-e8e8-4489-b013-fc39a3de2729 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.247878 Apr 20 19:33:32.618128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 305/666] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:32 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:32.769216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-85a72ced-6220-40f8-a43b-913435bf2205 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f03992bd158>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:32.836160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-85a72ced-6220-40f8-a43b-913435bf2205 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] HTTP exception thrown: Volume bb5aeb56-8ecd-4837-91f8-d178ad440e5d could not be found. Apr 20 19:33:32.836968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-85a72ced-6220-40f8-a43b-913435bf2205 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Returning 404 to user: Volume bb5aeb56-8ecd-4837-91f8-d178ad440e5d could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:32.837957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-85a72ced-6220-40f8-a43b-913435bf2205 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d" status: 404 len: 109 microversion: 2.1 time: 0.074115 Apr 20 19:33:32.838708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 362/667] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:33:32 2021] GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:33:32.855673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-18f14526-481a-421f-9cb0-c6a3f6d17c36 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f0387c54ea0>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:32.921056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-18f14526-481a-421f-9cb0-c6a3f6d17c36 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] HTTP exception thrown: Volume bb5aeb56-8ecd-4837-91f8-d178ad440e5d could not be found. Apr 20 19:33:32.922022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-18f14526-481a-421f-9cb0-c6a3f6d17c36 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Returning 404 to user: Volume bb5aeb56-8ecd-4837-91f8-d178ad440e5d could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:32.923162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-18f14526-481a-421f-9cb0-c6a3f6d17c36 tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d" status: 404 len: 109 microversion: 2.1 time: 0.071541 Apr 20 19:33:32.923882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 306/668] 10.222.0.38 () {58 vars in 1238 bytes} [Tue Apr 20 19:33:32 2021] DELETE /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:33:32.932832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3838ee74-0651-4d0b-92c6-8e416c8439fe tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Calling method '.version_select at 0x7f0395bb4048>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:32.996266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-3838ee74-0651-4d0b-92c6-8e416c8439fe tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] HTTP exception thrown: Volume bb5aeb56-8ecd-4837-91f8-d178ad440e5d could not be found. Apr 20 19:33:32.996972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3838ee74-0651-4d0b-92c6-8e416c8439fe tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] Returning 404 to user: Volume bb5aeb56-8ecd-4837-91f8-d178ad440e5d could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:32.997878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3838ee74-0651-4d0b-92c6-8e416c8439fe tempest-VolumesSnapshotsTestJSON-1347998858 tempest-VolumesSnapshotsTestJSON-1347998858-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d" status: 404 len: 109 microversion: 2.1 time: 0.069931 Apr 20 19:33:32.998472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 363/669] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:33:32 2021] GET /compute/v2.1/os-volumes/bb5aeb56-8ecd-4837-91f8-d178ad440e5d => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:33:33.637118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:33.638469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:33.647652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:33.648349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:33.649384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:33.650033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:33.962263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:33.972925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:33.974721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:33.976086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c126eb1f-0dc6-4bae-a202-bc18aaf3c14a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.342984 Apr 20 19:33:33.976849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 307/670] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:33 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:34.995660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:34.996478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:35.005153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:35.005835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:35.006859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:35.007511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:35.250365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:35.260803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:35.262825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:35.264193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6a307f8c-c9eb-4044-99cd-6a2721eaea0b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.272651 Apr 20 19:33:35.265211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 364/671] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:34 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:36.289263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:36.290223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:36.300195 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:36.300745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:36.301774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:36.302253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:36.553594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:36.564420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:36.566455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:36.567864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-81b3d132-1a94-4ccf-976c-6d0ef82efdea tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.284338 Apr 20 19:33:36.568633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 308/672] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:36 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:37.588491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:37.589200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:37.602084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:37.602604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:37.603464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:37.603964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:37.890305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:37.901338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:37.903679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:37.905192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-75f025f4-eaec-40f4-82a0-1dbf8a570c44 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1722 microversion: 2.20 time: 0.321084 Apr 20 19:33:37.906826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 365/673] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:37 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:38.927756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:38.929261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:38.944290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:38.945412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:38.947078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:38.949937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:38.978407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d8331924-ac80-42ad-8aa0-ad312ed189a4 req-12f6e0fa-6a72-4b1d-b726-7de8b5cbbd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ca897f-86b0-4162-a72d-2a399eef0f34", "name": "network-vif-deleted", "tag": "22a8b0f9-0716-4893-9db4-55b6fdf5988e"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:38.981023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:38.981023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:39.001661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d8331924-ac80-42ad-8aa0-ad312ed189a4 req-12f6e0fa-6a72-4b1d-b726-7de8b5cbbd77 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:39.005470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d8331924-ac80-42ad-8aa0-ad312ed189a4 req-12f6e0fa-6a72-4b1d-b726-7de8b5cbbd77 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:39.042922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-d8331924-ac80-42ad-8aa0-ad312ed189a4 req-12f6e0fa-6a72-4b1d-b726-7de8b5cbbd77 service nova] Creating event network-vif-deleted:22a8b0f9-0716-4893-9db4-55b6fdf5988e for instance 75ca897f-86b0-4162-a72d-2a399eef0f34 on hv-cinder-78726 Apr 20 19:33:39.061089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-d8331924-ac80-42ad-8aa0-ad312ed189a4 req-12f6e0fa-6a72-4b1d-b726-7de8b5cbbd77 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085453 Apr 20 19:33:39.062521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 366/674] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:33:39.208045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:39.218994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:39.221326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:39.222804 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-47bba422-cd7c-4270-8f49-0e825ff89cd2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 200 len: 1366 microversion: 2.20 time: 0.300478 Apr 20 19:33:39.223627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 309/675] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:38 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:39.706658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:39.707315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:39.723429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:39.724290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:39.725498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:39.726014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:39.903254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-712145582", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "596bcf58-391e-4602-ab04-a0fd13cc24ba"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:39.962105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lazy-loading 'services' on Instance uuid ab5ea3c1-a345-410c-8549-602f588efe60 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:33:40.002071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] validate_networks() for [('596bcf58-391e-4602-ab04-a0fd13cc24ba', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:33:40.190579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c220a68-7201-43c7-897a-d495b29b7abe tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "DELETE /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60/os-volume_attachments/6ff2c5e9-3357-4432-a68a-851230a34d8e" status: 202 len: 0 microversion: 2.1 time: 0.488036 Apr 20 19:33:40.191702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 367/676] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:33:39 2021] DELETE /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60/os-volume_attachments/6ff2c5e9-3357-4432-a68a-851230a34d8e => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:33:40.247252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:40.248554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:40.264361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:40.266693 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:40.274974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:40.276641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:40.353758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] HTTP exception thrown: Instance 75ca897f-86b0-4162-a72d-2a399eef0f34 could not be found. Apr 20 19:33:40.354433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Returning 404 to user: Instance 75ca897f-86b0-4162-a72d-2a399eef0f34 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:40.355338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a56c778b-7379-4612-bd1f-e928e887d581 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 404 len: 111 microversion: 2.20 time: 0.113514 Apr 20 19:33:40.355952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 368/677] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:40 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 20 19:33:40.366489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-facd2e1f-058f-46f5-ab82-2af00fd5628e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '.version_select at 0x7f039527e400>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:40.443500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-facd2e1f-058f-46f5-ab82-2af00fd5628e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-798277459" status: 204 len: 0 microversion: 2.20 time: 0.080771 Apr 20 19:33:40.444395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 369/678] 10.222.0.38 () {60 vars in 1249 bytes} [Tue Apr 20 19:33:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-798277459 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:33:40.886219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:33:40.886701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:33:40.887251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:33:40.887717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:33:40.888293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:33:40.903987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:40.904471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:40.905613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:40.906267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:40.927120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Getting quotas for project c06b12492e3c4c5494ee0cc799b046cd. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:33:40.932022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Getting quotas for user fe860dd9674242548283666ef51b333c and project c06b12492e3c4c5494ee0cc799b046cd. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:33:40.944096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:33:40.947191 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:33:41.007694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ae9a225f-a95d-4ae5-ad73-6f166e066ace tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111844 Apr 20 19:33:41.009435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 310/679] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:33:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:33:41.021487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a269f35d-3716-479f-99ad-43497af19e64 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:41.022555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a269f35d-3716-479f-99ad-43497af19e64 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:41.189839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a269f35d-3716-479f-99ad-43497af19e64 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:41.200783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a269f35d-3716-479f-99ad-43497af19e64 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1213 microversion: 2.1 time: 0.183760 Apr 20 19:33:41.216936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 370/680] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:41 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:42.224072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:42.224912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:42.233279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:42.234658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:42.235628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:42.236214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:42.372574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:42.384364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a9ea09a2-f3e7-4403-91ad-a2ff723e26a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1265 microversion: 2.1 time: 0.164678 Apr 20 19:33:42.385254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 311/681] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:42 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:42.652955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:42.653828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:42.664439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:42.665067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:42.666117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:42.666755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:42.744415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:33:42.899911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-71c34e25-9631-45d3-8625-28aa6eb52493 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "DELETE /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 204 len: 0 microversion: 2.1 time: 0.250639 Apr 20 19:33:42.900932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 371/682] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:33:42 2021] DELETE /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:33:42.910979 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:42.911907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:42.921059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:42.921756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:42.922762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:42.923516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:43.198031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:43.209116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f985b1e3-6b3b-4f10-a429-9d65582e66d9 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1514 microversion: 2.1 time: 0.303437 Apr 20 19:33:43.209999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 312/683] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:42 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:43.405911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:43.406692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:43.423208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:43.425521 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:43.429872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:43.438718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:43.447368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-28f8cc77-bdc8-42fd-8459-9c255cb36ba5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'create', calling method: .version_select at 0x7f03940d2378>, body: {"keypair": {"name": "tempest-keypair-2102400567"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:43.487337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-28f8cc77-bdc8-42fd-8459-9c255cb36ba5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:33:43.493197 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-28f8cc77-bdc8-42fd-8459-9c255cb36ba5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for user 844312487ddb474093c475e63bb58c8c and project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:33:43.628973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:43.643875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-954a2f39-6e85-40c4-9424-ddaf726c5aaf tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1271 microversion: 2.1 time: 0.242476 Apr 20 19:33:43.645378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 372/684] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:43 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:43.931856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-28f8cc77-bdc8-42fd-8459-9c255cb36ba5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:33:43.936362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-28f8cc77-bdc8-42fd-8459-9c255cb36ba5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for user 844312487ddb474093c475e63bb58c8c and project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:33:43.952243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-28f8cc77-bdc8-42fd-8459-9c255cb36ba5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.508764 Apr 20 19:33:43.959037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 313/685] 10.222.0.38 () {62 vars in 1189 bytes} [Tue Apr 20 19:33:43 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 511 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:33:44.230873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:44.231744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:44.240687 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:44.241459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:44.242493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:44.243149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:44.609220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:44.621105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4f7104d3-962e-4801-b103-ec30a685338c tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1514 microversion: 2.1 time: 0.394138 Apr 20 19:33:44.636695 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 373/686] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:44 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1514 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:44.663674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:44.664363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:44.676324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:44.676871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:44.677718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:44.678393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:45.011291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:45.022477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d88e3eea-dd8e-4848-bdd6-5c9f52cbf5f2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.362775 Apr 20 19:33:45.023395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 314/687] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:44 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:45.579617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-ef98cf2c-c249-459e-b3d2-f3c6adcdb669 req-bcd02a9a-3cb0-41ab-a2bf-8ec93b1db8ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db1531e-7154-4dd6-a37c-027df29f07d2", "tag": "df8d871a-89c0-4f10-9856-82f45a6c3bb8"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:45.581794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:45.581794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:45.591302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ef98cf2c-c249-459e-b3d2-f3c6adcdb669 req-bcd02a9a-3cb0-41ab-a2bf-8ec93b1db8ea service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:45.591798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ef98cf2c-c249-459e-b3d2-f3c6adcdb669 req-bcd02a9a-3cb0-41ab-a2bf-8ec93b1db8ea service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:45.613938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-ef98cf2c-c249-459e-b3d2-f3c6adcdb669 req-bcd02a9a-3cb0-41ab-a2bf-8ec93b1db8ea service nova] Creating event network-changed:df8d871a-89c0-4f10-9856-82f45a6c3bb8 for instance 6db1531e-7154-4dd6-a37c-027df29f07d2 on hv-cinder-78726 Apr 20 19:33:45.627408 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-ef98cf2c-c249-459e-b3d2-f3c6adcdb669 req-bcd02a9a-3cb0-41ab-a2bf-8ec93b1db8ea service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052437 Apr 20 19:33:45.628064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 374/688] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:45.644429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:45.645135 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:45.653174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:45.653670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:45.654722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:45.655227 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:46.042234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:46.043017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:46.051937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:46.053047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:46.054110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:46.054604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:46.457255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff879400ac734b22998db346bfc74242', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57e6ed91f174567963cdeb0df5ab371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:46.468974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ef641b8f-3fbd-4004-b628-b77cee678857 tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 200 len: 1514 microversion: 2.1 time: 0.828371 Apr 20 19:33:46.469771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 315/689] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:45 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 1514 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:46.628860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-fffb2584-af13-4117-aae9-fa39a9223953 req-39c5934a-b6ad-47eb-9e59-5299fb82d5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5ea3c1-a345-410c-8549-602f588efe60", "name": "network-vif-deleted", "tag": "3eba2c99-33e0-4daa-9a9d-cfc9bbd89c6c"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:46.631079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:46.631079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:46.640953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fffb2584-af13-4117-aae9-fa39a9223953 req-39c5934a-b6ad-47eb-9e59-5299fb82d5fa service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:46.641553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fffb2584-af13-4117-aae9-fa39a9223953 req-39c5934a-b6ad-47eb-9e59-5299fb82d5fa service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:46.660878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-fffb2584-af13-4117-aae9-fa39a9223953 req-39c5934a-b6ad-47eb-9e59-5299fb82d5fa service nova] Creating event network-vif-deleted:3eba2c99-33e0-4daa-9a9d-cfc9bbd89c6c for instance ab5ea3c1-a345-410c-8549-602f588efe60 on hv-cinder-78726 Apr 20 19:33:46.666572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-fffb2584-af13-4117-aae9-fa39a9223953 req-39c5934a-b6ad-47eb-9e59-5299fb82d5fa service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042181 Apr 20 19:33:46.667885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 316/690] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:33:46.682201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:46.693516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a09bb889-7ff3-45d8-8722-e7e1458b1199 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.655681 Apr 20 19:33:46.695610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 375/691] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:46 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:47.489483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:47.490383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] [instance: ab5ea3c1-a345-410c-8549-602f588efe60] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:47.507340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:47.507828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:47.509067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:47.509717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:47.568602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] HTTP exception thrown: Instance ab5ea3c1-a345-410c-8549-602f588efe60 could not be found. Apr 20 19:33:47.569315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] Returning 404 to user: Instance ab5ea3c1-a345-410c-8549-602f588efe60 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:33:47.570232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ecc87add-9a37-4fcb-97f6-af2b065b618d tempest-VolumesSnapshotTestJSON-527896682 tempest-VolumesSnapshotTestJSON-527896682-project] 10.222.0.38 "GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60" status: 404 len: 111 microversion: 2.1 time: 0.085706 Apr 20 19:33:47.571140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 317/692] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:47 2021] GET /compute/v2.1/servers/ab5ea3c1-a345-410c-8549-602f588efe60 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:33:47.688691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1548752519", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82da78ec-751b-430a-a7da-562971e5fcc7"}], "security_groups": [{"name": "tempest-securitygroup--503927343"}], "key_name": "tempest-keypair-2102400567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:47.713134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:47.714183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:47.725229 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:47.725990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:47.727550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:47.728407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:47.961214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] validate_networks() for [('82da78ec-751b-430a-a7da-562971e5fcc7', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:33:48.134924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:48.146779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-807faf12-961e-4ae6-8857-f0519b01d57c tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.437668 Apr 20 19:33:48.147777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 318/693] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:47 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:48.631436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:33:48.631964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:33:48.632580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:33:48.633078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:33:48.633589 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:33:48.643322 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:48.643768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:48.644676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:48.645185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:48.663772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:33:48.667997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Getting quotas for user 844312487ddb474093c475e63bb58c8c and project 7899154aeb3b4d1387b43d42a0a50996. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:33:48.679523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:33:48.682207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:33:48.736004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6dcec93a-89b1-438f-b0a7-89557957908a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.052915 Apr 20 19:33:48.741085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 376/694] 10.222.0.38 () {62 vars in 1178 bytes} [Tue Apr 20 19:33:47 2021] POST /compute/v2.1/servers => generated 401 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 19:33:48.747338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7fed1de3-a7cd-4f86-a1b3-d500122d5d1b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:48.747979 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7fed1de3-a7cd-4f86-a1b3-d500122d5d1b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:48.833129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7fed1de3-a7cd-4f86-a1b3-d500122d5d1b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:48.842912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7fed1de3-a7cd-4f86-a1b3-d500122d5d1b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:48.844594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7fed1de3-a7cd-4f86-a1b3-d500122d5d1b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:48.845907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7fed1de3-a7cd-4f86-a1b3-d500122d5d1b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1282 microversion: 2.20 time: 0.102485 Apr 20 19:33:48.846401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 319/695] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:48 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:49.166130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:49.166755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:49.175726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:49.176243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:49.177161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:49.177663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:49.424775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:49.433903 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-770a86d4-191b-42ff-a37b-d87ba9ee077b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.272133 Apr 20 19:33:49.435020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 377/696] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:49 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:49.866717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:49.867390 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:49.877143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:49.877657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:49.878504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:49.879006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:50.007827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:50.017311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:50.019178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:50.021030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-94ef246a-fd42-4be5-9505-41a9943e901a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1334 microversion: 2.20 time: 0.158430 Apr 20 19:33:50.021644 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 320/697] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:49 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1334 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:50.455036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:50.455637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:50.463763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:50.464276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:50.465150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:50.465648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:50.687950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:50.696810 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79bac086-c21f-466f-beb1-8986aa2b6734 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.246594 Apr 20 19:33:50.697450 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 378/698] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:50 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:51.041061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:51.041734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:51.049817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:51.050335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:51.051190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:51.051703 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:51.175304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:51.184769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:51.186994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:51.188287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-477309eb-a266-475d-baa5-ebd9d18dfd25 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1334 microversion: 2.20 time: 0.151310 Apr 20 19:33:51.188931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 321/699] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:51 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1334 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:51.714342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:51.715016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:51.723421 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:51.723929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:51.724875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:51.725380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:51.941516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:51.950278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eee020d8-62db-45cc-a55d-6783dc82fa57 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.240010 Apr 20 19:33:51.950904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 379/700] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:51 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:52.208115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:52.208735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:52.216626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:52.217171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:52.218625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:52.219126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:52.343567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:52.353033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:52.354708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:52.355878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed818dd7-478d-4fa9-b61c-2ea771cff4b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1334 microversion: 2.20 time: 0.151943 Apr 20 19:33:52.356498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 322/701] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:52 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1334 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:52.970669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:52.971361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:52.979510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:52.980028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:52.980937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:52.981440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:53.203510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:53.212444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bd7140b2-60fe-44aa-a19d-90c9669a776e tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.247351 Apr 20 19:33:53.213342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 380/702] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:52 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:53.375627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:53.376222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:53.384400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:53.384984 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:53.385836 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:53.386335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:53.621721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:53.632621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:53.634736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:53.636209 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b6c62056-23ee-4c19-af65-aabb85bb1edf tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.264941 Apr 20 19:33:53.637590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 323/703] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:53 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:54.230871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:54.232256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:54.245785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:54.246664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:54.247757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:54.248577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:54.614411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:54.625968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fa96b633-45ec-4dd9-8b9d-470085169075 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.398349 Apr 20 19:33:54.627246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 381/704] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:54 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:54.658481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:54.659249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:54.669399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:54.669945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:54.671712 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:54.672371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:54.917527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:54.935329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:54.938354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:54.939871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-adaeb8dd-4419-409d-82b1-27424c0f8f20 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.286578 Apr 20 19:33:54.942094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 324/705] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:54 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:55.118729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-be2e37ae-d838-49e1-96b9-d23743d63f2a req-a310c1d8-f479-4861-9bfb-c2b08e8fd5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3257299-ff9d-47e8-862f-5d8becad1633", "tag": "a3a21964-a28d-45cc-b821-a61ffedb9528"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:55.120847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:55.120847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:55.146623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-be2e37ae-d838-49e1-96b9-d23743d63f2a req-a310c1d8-f479-4861-9bfb-c2b08e8fd5d4 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:55.147145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-be2e37ae-d838-49e1-96b9-d23743d63f2a req-a310c1d8-f479-4861-9bfb-c2b08e8fd5d4 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:55.173312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-be2e37ae-d838-49e1-96b9-d23743d63f2a req-a310c1d8-f479-4861-9bfb-c2b08e8fd5d4 service nova] Creating event network-changed:a3a21964-a28d-45cc-b821-a61ffedb9528 for instance c3257299-ff9d-47e8-862f-5d8becad1633 on hv-cinder-78726 Apr 20 19:33:55.179545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-be2e37ae-d838-49e1-96b9-d23743d63f2a req-a310c1d8-f479-4861-9bfb-c2b08e8fd5d4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066995 Apr 20 19:33:55.180754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 382/706] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:55.213190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-12c692c3-fbc9-4377-b303-00b2347a1d87 req-9ceabbb7-e2fc-4828-b84b-57a4d320e0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db1531e-7154-4dd6-a37c-027df29f07d2", "name": "network-vif-plugged", "status": "completed", "tag": "df8d871a-89c0-4f10-9856-82f45a6c3bb8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:33:55.215009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:33:55.215009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:33:55.226199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-12c692c3-fbc9-4377-b303-00b2347a1d87 req-9ceabbb7-e2fc-4828-b84b-57a4d320e0ce service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:55.227265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-12c692c3-fbc9-4377-b303-00b2347a1d87 req-9ceabbb7-e2fc-4828-b84b-57a4d320e0ce service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:55.246222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-12c692c3-fbc9-4377-b303-00b2347a1d87 req-9ceabbb7-e2fc-4828-b84b-57a4d320e0ce service nova] Creating event network-vif-plugged:df8d871a-89c0-4f10-9856-82f45a6c3bb8 for instance 6db1531e-7154-4dd6-a37c-027df29f07d2 on hv-cinder-78726 Apr 20 19:33:55.253013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-12c692c3-fbc9-4377-b303-00b2347a1d87 req-9ceabbb7-e2fc-4828-b84b-57a4d320e0ce service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043833 Apr 20 19:33:55.254253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 325/707] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:33:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:33:55.645586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:55.646412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:55.659587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:55.660106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:55.660985 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:55.661684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:55.897813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:55.908057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a6102764-d856-4858-9604-eb2c58786336 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1313 microversion: 2.1 time: 0.268079 Apr 20 19:33:55.908665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 383/708] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:55 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:55.961828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:55.962891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:55.971054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:55.971683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:55.973131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:55.973777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:56.430515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:56.442358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:56.443940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:56.445380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ed0c358-2508-42c7-afdf-77794805fada tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.488444 Apr 20 19:33:56.445995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 326/709] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:55 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:56.926752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:56.928535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:56.939492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:56.939999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:56.940901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:56.941401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:57.314810 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:57.325799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7b1aa0e4-6e41-42e1-8362-11e91a0dcb45 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1496 microversion: 2.1 time: 0.403432 Apr 20 19:33:57.327977 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 384/710] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:56 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1496 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:57.465513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:57.466856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:57.481151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:57.481649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:57.495227 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:57.495745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:58.059351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:58.070078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:58.071806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:58.073044 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8d5cbc92-b496-41e6-835b-5cfa8863a9d3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.611727 Apr 20 19:33:58.073857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 327/711] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:57 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:33:58.442963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:58.443775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:58.451881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:58.452695 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:58.453793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:58.454499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:58.525956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:33:58.669066 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9a2c0a3a-0b48-4361-8151-fdf841356cef tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "DELETE /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 204 len: 0 microversion: 2.1 time: 0.229575 Apr 20 19:33:58.675493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 385/712] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:33:58 2021] DELETE /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:33:58.679634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:58.680544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:58.690554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:58.692097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:58.693696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:58.694565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:59.072723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:59.082248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60b12c3c-1099-4f0d-8ed5-54432ffe0247 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1502 microversion: 2.1 time: 0.407118 Apr 20 19:33:59.083518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 328/713] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:33:58 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1502 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:33:59.094805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:33:59.095582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:33:59.103582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:59.104058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:59.104966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:33:59.105463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:33:59.586993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:59.597424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:59.599591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:33:59.600905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cd52cd57-ddb5-4ec4-8d9e-3b7bdbc83dcc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.511271 Apr 20 19:33:59.601594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 386/714] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:33:59 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:34:00.101968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:00.102642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:00.111766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:00.112276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:00.113586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:00.114045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:00.621356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:00.622096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:00.632198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:00.632727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:00.633583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:00.634077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:00.698587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:00.709308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-21b0d87f-ca8a-431a-8c75-00433078e31b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1502 microversion: 2.1 time: 0.611284 Apr 20 19:34:00.720308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 329/715] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:00 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1502 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:01.181198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:01.191172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:01.192997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:01.194244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0d59a5b9-95ff-4ecc-af43-8b1725bba20c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.577133 Apr 20 19:34:01.194868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 387/716] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:34:00 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:34:01.727738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:01.728612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:01.736940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:01.737552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:01.738491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:01.739203 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:02.187666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:02.196890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-273e0892-5075-4ed7-bfd6-74898419d2ab tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1502 microversion: 2.1 time: 0.473109 Apr 20 19:34:02.197795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 330/717] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:01 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1502 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:02.214629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:02.215301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:02.223879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:02.224385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:02.225234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:02.225919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:02.874187 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:02.896140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:02.899026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:02.900582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f5d631ac-3df9-45ea-a84f-feeea900fef1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.690004 Apr 20 19:34:02.901423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 388/718] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:34:02 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:34:03.216879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:03.218468 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:03.235476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:03.236003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:03.236917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:03.237439 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:03.597292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:03.609129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-395ddf6b-fa7c-4ec2-87f6-7b577106d8f3 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1502 microversion: 2.1 time: 0.397188 Apr 20 19:34:03.613014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 331/719] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:03 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:03.922654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:03.923471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:03.940904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:03.943579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:03.944735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:03.947941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:04.077544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-647ebd80-7a75-441c-9f30-6e538b5219e9 req-bdd371be-3cac-4faa-a38f-61376faea646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db1531e-7154-4dd6-a37c-027df29f07d2", "name": "network-vif-deleted", "tag": "df8d871a-89c0-4f10-9856-82f45a6c3bb8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:04.080027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:04.080027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:04.100513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-647ebd80-7a75-441c-9f30-6e538b5219e9 req-bdd371be-3cac-4faa-a38f-61376faea646 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:04.101298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-647ebd80-7a75-441c-9f30-6e538b5219e9 req-bdd371be-3cac-4faa-a38f-61376faea646 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:04.120340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-647ebd80-7a75-441c-9f30-6e538b5219e9 req-bdd371be-3cac-4faa-a38f-61376faea646 service nova] Creating event network-vif-deleted:df8d871a-89c0-4f10-9856-82f45a6c3bb8 for instance 6db1531e-7154-4dd6-a37c-027df29f07d2 on hv-cinder-78726 Apr 20 19:34:04.128914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-647ebd80-7a75-441c-9f30-6e538b5219e9 req-bdd371be-3cac-4faa-a38f-61376faea646 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055830 Apr 20 19:34:04.133817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 332/720] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:04.440889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:04.465603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:04.468770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:04.471837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ebba86fd-9f69-4376-951f-55cf06188a7b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.554138 Apr 20 19:34:04.473098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 389/721] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:34:03 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:34:04.631211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:04.632500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:04.646345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:04.647414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:04.649701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:04.651516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:04.797093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:04.798110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:04.798647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lazy-loading 'fault' on Instance uuid 6db1531e-7154-4dd6-a37c-027df29f07d2 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:34:04.948167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:04.960594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b8e94dd4-9e7d-496e-8c02-9654aaf00d94 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 200 len: 1303 microversion: 2.1 time: 0.336437 Apr 20 19:34:04.970212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 333/722] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:04 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 1303 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:05.130315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-f843c089-4046-4409-8abb-05f3234ba8d5 req-b14c12d8-d730-4797-a185-22c6b7e5cf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3257299-ff9d-47e8-862f-5d8becad1633", "name": "network-vif-plugged", "status": "completed", "tag": "a3a21964-a28d-45cc-b821-a61ffedb9528"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:05.132834 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:05.132834 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:05.150354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f843c089-4046-4409-8abb-05f3234ba8d5 req-b14c12d8-d730-4797-a185-22c6b7e5cf58 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:05.153727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f843c089-4046-4409-8abb-05f3234ba8d5 req-b14c12d8-d730-4797-a185-22c6b7e5cf58 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:05.195002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-f843c089-4046-4409-8abb-05f3234ba8d5 req-b14c12d8-d730-4797-a185-22c6b7e5cf58 service nova] Creating event network-vif-plugged:a3a21964-a28d-45cc-b821-a61ffedb9528 for instance c3257299-ff9d-47e8-862f-5d8becad1633 on hv-cinder-78726 Apr 20 19:34:05.200601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-f843c089-4046-4409-8abb-05f3234ba8d5 req-b14c12d8-d730-4797-a185-22c6b7e5cf58 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074323 Apr 20 19:34:05.201640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 390/723] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:05.495475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:05.496343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:05.524957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:05.527094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:05.528059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:05.529363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:05.618321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:05.619123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:05.635961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:05.648617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:05.649819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:05.650441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:05.760562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:34:05.924126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-689dfbcf-4674-4df2-85e7-2a874349aedb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 204 len: 0 microversion: 2.1 time: 0.310977 Apr 20 19:34:05.924791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 391/724] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:34:05 2021] DELETE /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:34:05.934655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:05.935748 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:05.945395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:05.945917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:05.946789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:05.947289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:06.127487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:06.146084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:06.148076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:06.151494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7c2ffab7-4ce7-4ec4-b211-fc6304800864 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.663215 Apr 20 19:34:06.152142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 334/725] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:34:05 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:34:06.157857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:06.158532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 6db1531e-7154-4dd6-a37c-027df29f07d2] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:06.176950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:06.177809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:06.178853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:06.179529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:06.247729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] HTTP exception thrown: Instance 6db1531e-7154-4dd6-a37c-027df29f07d2 could not be found. Apr 20 19:34:06.248333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Returning 404 to user: Instance 6db1531e-7154-4dd6-a37c-027df29f07d2 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:34:06.249782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fdb9dce4-e113-4cc7-891c-d224e57c65a1 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2" status: 404 len: 111 microversion: 2.1 time: 0.096618 Apr 20 19:34:06.250391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 335/726] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:06 2021] GET /compute/v2.1/servers/6db1531e-7154-4dd6-a37c-027df29f07d2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:34:06.276472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:06.288824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9ff744d1-f8af-41d8-b029-e5853135423f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1671 microversion: 2.1 time: 0.359152 Apr 20 19:34:06.294216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 392/727] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:05 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1671 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:06.413087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-274341943", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "networks": [{"uuid": "596bcf58-391e-4602-ab04-a0fd13cc24ba"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:06.496254 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] validate_networks() for [('596bcf58-391e-4602-ab04-a0fd13cc24ba', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:34:07.171774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:07.173724 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:07.192555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:07.193424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:07.194457 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:07.195125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:07.588570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:07.600384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:07.602256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:07.603772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-12050523-0e39-45a8-86ee-ab78981262a0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1407 microversion: 2.20 time: 0.436620 Apr 20 19:34:07.604516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 393/728] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:34:07 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:34:07.610119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:07.610874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:07.619554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:07.620205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:07.621118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:07.622060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:07.628489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:34:07.629035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:34:07.629588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:34:07.630029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:34:07.630703 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:34:07.639843 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:07.640356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:07.641261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:07.641757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:07.661021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Getting quotas for project c06b12492e3c4c5494ee0cc799b046cd. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:34:07.665336 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Getting quotas for user fe860dd9674242548283666ef51b333c and project c06b12492e3c4c5494ee0cc799b046cd. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:34:07.677313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:34:07.680036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:34:07.732587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b63aa41d-6440-47a9-82c7-fc7edb45eea2 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.325198 Apr 20 19:34:07.733859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 336/729] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:34:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 19:34:07.744444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-76995357-0667-4b84-afdf-40d6541afb9b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:07.745503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-76995357-0667-4b84-afdf-40d6541afb9b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:07.832374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-76995357-0667-4b84-afdf-40d6541afb9b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:07.842634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-76995357-0667-4b84-afdf-40d6541afb9b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1213 microversion: 2.1 time: 0.102197 Apr 20 19:34:07.854572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 337/730] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:07 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:07.918809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:07.928566 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d1ad029b-2597-4da3-8339-309c8c470ddd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1671 microversion: 2.1 time: 0.322875 Apr 20 19:34:07.929220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 394/731] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:07 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1671 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:08.624511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:08.625816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:08.635189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:08.635705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:08.636888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:08.637076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:08.863829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:08.864771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:08.877856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:08.883838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:08.884999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:08.885666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:09.101167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:09.113120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4e57167a-a561-4b91-83ac-f64c712fe002 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1265 microversion: 2.1 time: 0.253702 Apr 20 19:34:09.114188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 395/732] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:08 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:09.120417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:09.121373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:09.130727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:09.131540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:09.132630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:09.133379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:09.589358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:09.606929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:09.611486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:09.617846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3a2d56ad-5bec-4c0f-bab7-6439d72e2341 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1599 microversion: 2.20 time: 0.997965 Apr 20 19:34:09.620640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 338/733] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:34:08 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1599 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:34:09.646510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ae4afdc5-1894-48e6-9298-c3013d4cedd1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:09.647071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ae4afdc5-1894-48e6-9298-c3013d4cedd1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:09.655470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae4afdc5-1894-48e6-9298-c3013d4cedd1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:09.656130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae4afdc5-1894-48e6-9298-c3013d4cedd1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:09.657888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae4afdc5-1894-48e6-9298-c3013d4cedd1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:09.658398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae4afdc5-1894-48e6-9298-c3013d4cedd1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:10.600018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ae4afdc5-1894-48e6-9298-c3013d4cedd1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.959438 Apr 20 19:34:10.621892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:10.625503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 339/734] 10.222.0.38 () {60 vars in 1306 bytes} [Tue Apr 20 19:34:09 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/os-interface => generated 285 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:34:10.645840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:10.652369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:10.672817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e9a1266e-e935-4eb4-9c07-4c80e0d7e04b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1671 microversion: 2.1 time: 1.546893 Apr 20 19:34:10.673887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 396/735] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:09 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1671 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:10.686059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:10.700837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:10.706141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:10.706893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:11.692131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:11.693455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:11.711132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:11.711872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:11.712953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:11.713652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:12.079809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:12.096674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2ce9eb79-dc0a-41df-b759-7e352a715931 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1313 microversion: 2.1 time: 1.468918 Apr 20 19:34:12.097345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 340/736] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:10 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1313 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:12.248151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-961b5371-b3cc-4b9d-88f7-4d6034143d86 req-9325d657-04e2-4747-a607-a831b67ff648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f8f2c1-a94c-40db-970e-735e1181f265", "tag": "0102065e-8eff-4774-a05a-016694bb90d2"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:12.266699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:12.266699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:12.292215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-961b5371-b3cc-4b9d-88f7-4d6034143d86 req-9325d657-04e2-4747-a607-a831b67ff648 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:12.298735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-961b5371-b3cc-4b9d-88f7-4d6034143d86 req-9325d657-04e2-4747-a607-a831b67ff648 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:12.326189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-961b5371-b3cc-4b9d-88f7-4d6034143d86 req-9325d657-04e2-4747-a607-a831b67ff648 service nova] Creating event network-changed:0102065e-8eff-4774-a05a-016694bb90d2 for instance 47f8f2c1-a94c-40db-970e-735e1181f265 on hv-cinder-78726 Apr 20 19:34:12.350600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-961b5371-b3cc-4b9d-88f7-4d6034143d86 req-9325d657-04e2-4747-a607-a831b67ff648 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106188 Apr 20 19:34:12.351778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 341/737] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:13.116335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:13.117889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:13.126982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:13.127969 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:13.129106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:13.130927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:13.908416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:13.917616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1ec7ffe2-2447-4663-a9ce-7f3d2faae3a5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1671 microversion: 2.1 time: 2.230141 Apr 20 19:34:13.918344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 397/738] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:11 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1671 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:14.423051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:14.435348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c20cdd47-8cf0-4457-a5af-7364fe53ac62 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1313 microversion: 2.1 time: 1.323440 Apr 20 19:34:14.436924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 342/739] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:13 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1313 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:34:14.936872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:14.937677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:14.944340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-af6b7e64-36b7-45d8-9274-eaebb193dee4 req-995b0815-d83c-4c02-8003-5c422a1f9271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ed4913-e7ef-455c-9061-477f1274e3b7", "name": "network-vif-deleted", "tag": "8e197005-0c8e-41e1-ac1e-defb1c9d189c"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:14.946147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:14.946147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:14.962003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-af6b7e64-36b7-45d8-9274-eaebb193dee4 req-995b0815-d83c-4c02-8003-5c422a1f9271 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:14.963849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:14.964543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:14.965293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-af6b7e64-36b7-45d8-9274-eaebb193dee4 req-995b0815-d83c-4c02-8003-5c422a1f9271 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:14.966353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:14.972602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:14.988144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-af6b7e64-36b7-45d8-9274-eaebb193dee4 req-995b0815-d83c-4c02-8003-5c422a1f9271 service nova] Creating event network-vif-deleted:8e197005-0c8e-41e1-ac1e-defb1c9d189c for instance d9ed4913-e7ef-455c-9061-477f1274e3b7 on hv-cinder-78726 Apr 20 19:34:14.994329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-af6b7e64-36b7-45d8-9274-eaebb193dee4 req-995b0815-d83c-4c02-8003-5c422a1f9271 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053974 Apr 20 19:34:14.995274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 343/740] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:34:15.403674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:15.429196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3f9141ca-2042-43e4-be73-9b8976539b0f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 200 len: 1604 microversion: 2.1 time: 0.496851 Apr 20 19:34:15.439888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 398/741] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:14 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 1604 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:15.455020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:15.455917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:15.478610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:15.479309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:15.480497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:15.481641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:16.079247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:16.096603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-771bc4ee-a386-4542-af34-f5825c267476 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:16.098606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-771bc4ee-a386-4542-af34-f5825c267476 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:16.116578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a00cf076-cf6e-43b3-8bcd-ffccd3344419 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1313 microversion: 2.1 time: 0.666329 Apr 20 19:34:16.120060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 344/742] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:15 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:16.122767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-771bc4ee-a386-4542-af34-f5825c267476 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:16.123672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-771bc4ee-a386-4542-af34-f5825c267476 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:16.124750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-771bc4ee-a386-4542-af34-f5825c267476 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:16.125433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-771bc4ee-a386-4542-af34-f5825c267476 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:16.327331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-771bc4ee-a386-4542-af34-f5825c267476 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 14 microversion: 2.20 time: 0.234446 Apr 20 19:34:16.328340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 399/743] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:16 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 14 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:16.450621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:16.451289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:16.466528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:16.467690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:16.468746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:16.469304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:16.578398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] HTTP exception thrown: Instance d9ed4913-e7ef-455c-9061-477f1274e3b7 could not be found. Apr 20 19:34:16.579316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Returning 404 to user: Instance d9ed4913-e7ef-455c-9061-477f1274e3b7 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:34:16.580327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7546d600-0ef8-4bbd-8bc3-72f407f6b724 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 404 len: 111 microversion: 2.1 time: 0.133793 Apr 20 19:34:16.584887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 345/744] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:16 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:34:16.591248 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-78ea3584-50b9-4feb-bf35-869212e8fe97 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '.version_select at 0x7f03946f3378>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:16.627906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-78ea3584-50b9-4feb-bf35-869212e8fe97 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110473747" status: 202 len: 0 microversion: 2.1 time: 0.041677 Apr 20 19:34:16.629125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 400/745] 10.222.0.38 () {58 vars in 1208 bytes} [Tue Apr 20 19:34:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110473747 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:17.141215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:17.141215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:17.155700 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:17.159967 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:17.160700 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:17.161235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:17.339782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83944e82-a8af-4371-b38c-d266f68598fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:17.341172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83944e82-a8af-4371-b38c-d266f68598fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:17.355627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83944e82-a8af-4371-b38c-d266f68598fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:17.356453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83944e82-a8af-4371-b38c-d266f68598fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:17.357533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83944e82-a8af-4371-b38c-d266f68598fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:17.358213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83944e82-a8af-4371-b38c-d266f68598fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:17.531584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83944e82-a8af-4371-b38c-d266f68598fa tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 14 microversion: 2.20 time: 0.195667 Apr 20 19:34:17.533453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 401/746] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:17 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:17.540441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-cfc9da6e-d7a8-4c7a-8679-8d2829ebbcb1 req-cf30b4c8-4bfd-4c91-8a30-4adb75e68f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3257299-ff9d-47e8-862f-5d8becad1633", "tag": "a3a21964-a28d-45cc-b821-a61ffedb9528"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:17.542398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:17.542398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:17.555332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-cfc9da6e-d7a8-4c7a-8679-8d2829ebbcb1 req-cf30b4c8-4bfd-4c91-8a30-4adb75e68f42 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:17.556136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-cfc9da6e-d7a8-4c7a-8679-8d2829ebbcb1 req-cf30b4c8-4bfd-4c91-8a30-4adb75e68f42 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:17.578308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-cfc9da6e-d7a8-4c7a-8679-8d2829ebbcb1 req-cf30b4c8-4bfd-4c91-8a30-4adb75e68f42 service nova] Creating event network-changed:a3a21964-a28d-45cc-b821-a61ffedb9528 for instance c3257299-ff9d-47e8-862f-5d8becad1633 on hv-cinder-78726 Apr 20 19:34:17.584864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-cfc9da6e-d7a8-4c7a-8679-8d2829ebbcb1 req-cf30b4c8-4bfd-4c91-8a30-4adb75e68f42 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049455 Apr 20 19:34:17.586112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 402/747] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:17.912970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:17.926101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6c572db6-d301-431a-af67-2e9501d6fa2b tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1313 microversion: 2.1 time: 0.792227 Apr 20 19:34:17.927196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 346/748] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:17 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1313 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:18.545585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44788dda-5f28-4657-a63b-69c36ce4498f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:18.547688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44788dda-5f28-4657-a63b-69c36ce4498f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:18.558624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a95999cf-409f-4d80-ae97-d055e9bf2fda req-8bdd002d-f652-4b5f-b65b-a644a6b70936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f8f2c1-a94c-40db-970e-735e1181f265", "name": "network-vif-plugged", "status": "completed", "tag": "0102065e-8eff-4774-a05a-016694bb90d2"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:18.560630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:18.560630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:18.570998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44788dda-5f28-4657-a63b-69c36ce4498f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:18.573719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44788dda-5f28-4657-a63b-69c36ce4498f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:18.575790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a95999cf-409f-4d80-ae97-d055e9bf2fda req-8bdd002d-f652-4b5f-b65b-a644a6b70936 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:18.577721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44788dda-5f28-4657-a63b-69c36ce4498f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:18.578529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a95999cf-409f-4d80-ae97-d055e9bf2fda req-8bdd002d-f652-4b5f-b65b-a644a6b70936 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:18.579261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44788dda-5f28-4657-a63b-69c36ce4498f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:18.632443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a95999cf-409f-4d80-ae97-d055e9bf2fda req-8bdd002d-f652-4b5f-b65b-a644a6b70936 service nova] Creating event network-vif-plugged:0102065e-8eff-4774-a05a-016694bb90d2 for instance 47f8f2c1-a94c-40db-970e-735e1181f265 on hv-cinder-78726 Apr 20 19:34:18.646860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a95999cf-409f-4d80-ae97-d055e9bf2fda req-8bdd002d-f652-4b5f-b65b-a644a6b70936 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089355 Apr 20 19:34:18.648514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 347/749] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:18.765447 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44788dda-5f28-4657-a63b-69c36ce4498f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 14 microversion: 2.20 time: 0.224575 Apr 20 19:34:18.766352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 403/750] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:18 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 14 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:18.945527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:18.946781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:18.956963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:18.958021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:18.959176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:18.959904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:19.777777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b18e4418-2ce7-4096-ad28-2ecf32dd431b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:19.778994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b18e4418-2ce7-4096-ad28-2ecf32dd431b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:19.788541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b18e4418-2ce7-4096-ad28-2ecf32dd431b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:19.789083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b18e4418-2ce7-4096-ad28-2ecf32dd431b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:19.789946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b18e4418-2ce7-4096-ad28-2ecf32dd431b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:19.790455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b18e4418-2ce7-4096-ad28-2ecf32dd431b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:19.944382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b18e4418-2ce7-4096-ad28-2ecf32dd431b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 7493 microversion: 2.20 time: 0.171098 Apr 20 19:34:19.945131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 404/751] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:19 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 7493 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:34:19.990475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:20.001313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1fad4a72-6068-40ac-8531-6c309c80750f tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1313 microversion: 2.1 time: 1.060817 Apr 20 19:34:20.002060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 348/752] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:18 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1313 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:20.437638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-888aaccf-528d-4096-b3f2-43c7598f2f46 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'create', calling method: .version_select at 0x7f0395bb4bf8>, body: {"keypair": {"name": "tempest-keypair-1805385338"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:20.478825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-888aaccf-528d-4096-b3f2-43c7598f2f46 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:34:20.484817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-888aaccf-528d-4096-b3f2-43c7598f2f46 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for user 998b5783d8804bfa8d4a1c016b5666be and project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:34:20.593571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-888aaccf-528d-4096-b3f2-43c7598f2f46 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:34:20.597998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-888aaccf-528d-4096-b3f2-43c7598f2f46 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for user 998b5783d8804bfa8d4a1c016b5666be and project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:34:20.613710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-888aaccf-528d-4096-b3f2-43c7598f2f46 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.558173 Apr 20 19:34:20.614582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 405/753] 10.222.0.38 () {60 vars in 1148 bytes} [Tue Apr 20 19:34:20 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:20.956068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ec20e2c4-a362-4377-b31b-3c4578bfa39d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:20.957150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ec20e2c4-a362-4377-b31b-3c4578bfa39d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:20.965814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec20e2c4-a362-4377-b31b-3c4578bfa39d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:20.966331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec20e2c4-a362-4377-b31b-3c4578bfa39d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:20.967772 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec20e2c4-a362-4377-b31b-3c4578bfa39d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:20.968231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec20e2c4-a362-4377-b31b-3c4578bfa39d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:21.021301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:21.022589 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:21.033255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:21.034531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:21.036636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:21.037239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:21.099864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ec20e2c4-a362-4377-b31b-3c4578bfa39d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 15025 microversion: 2.20 time: 0.147664 Apr 20 19:34:21.101103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 349/754] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:20 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 15025 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:21.581122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:21.590533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1c556633-9730-4de4-9249-e906401108cc tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1496 microversion: 2.1 time: 0.575082 Apr 20 19:34:21.591243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 406/755] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:21 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1496 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:22.118867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8c3b7410-389d-40a2-9df4-4dbdba2ab80f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:22.120044 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8c3b7410-389d-40a2-9df4-4dbdba2ab80f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:22.134938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c3b7410-389d-40a2-9df4-4dbdba2ab80f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:22.135460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c3b7410-389d-40a2-9df4-4dbdba2ab80f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:22.136330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c3b7410-389d-40a2-9df4-4dbdba2ab80f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:22.136856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8c3b7410-389d-40a2-9df4-4dbdba2ab80f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:22.329493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8c3b7410-389d-40a2-9df4-4dbdba2ab80f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 18561 microversion: 2.20 time: 0.219810 Apr 20 19:34:22.330368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 350/756] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:22 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 18561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:22.427289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-90dc96e8-d1aa-46c6-a41b-548ade77f338 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Action: 'create', calling method: .version_select at 0x7f03946f3b70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1537066604"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:22.454003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-90dc96e8-d1aa-46c6-a41b-548ade77f338 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Getting quotas for project ba7e670538c341e6a378232973d1ccde. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:34:22.458327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-90dc96e8-d1aa-46c6-a41b-548ade77f338 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Getting quotas for user 22a8daafdd5147a9a0b726981c16cabe and project ba7e670538c341e6a378232973d1ccde. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:34:22.630641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:22.631674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:22.641201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:22.642041 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:22.643101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:22.643790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:22.720111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:34:22.730943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-90dc96e8-d1aa-46c6-a41b-548ade77f338 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Getting quotas for project ba7e670538c341e6a378232973d1ccde. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:34:22.736536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-90dc96e8-d1aa-46c6-a41b-548ade77f338 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Getting quotas for user 22a8daafdd5147a9a0b726981c16cabe and project ba7e670538c341e6a378232973d1ccde. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:34:22.752886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-90dc96e8-d1aa-46c6-a41b-548ade77f338 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.464701 Apr 20 19:34:22.753791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 407/757] 10.222.0.38 () {60 vars in 1148 bytes} [Tue Apr 20 19:34:22 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:22.876973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ff35815-c92c-459a-a322-42df6b3a8923 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "DELETE /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 204 len: 0 microversion: 2.1 time: 0.250298 Apr 20 19:34:22.878016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 351/758] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:34:22 2021] DELETE /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 19:34:22.886750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:22.887429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:22.897104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:22.897626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:22.898497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:22.899013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:23.187752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-359683822", "imageRef": "ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4427720-1bf7-4b3c-8e43-4a0696109808"}], "security_groups": [{"name": "tempest-securitygroup--798120437"}], "key_name": "tempest-keypair-1805385338", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:23.210161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:23.219730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-065fcb74-a06d-46b8-ac17-8b855d7df688 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1502 microversion: 2.1 time: 0.336973 Apr 20 19:34:23.220372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 408/759] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:22 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1502 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:23.342610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-df8aac13-a263-4741-ad0b-6b85c50632a6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:23.344602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] validate_networks() for [('f4427720-1bf7-4b3c-8e43-4a0696109808', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:34:23.350897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-df8aac13-a263-4741-ad0b-6b85c50632a6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:23.359443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df8aac13-a263-4741-ad0b-6b85c50632a6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:23.360165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df8aac13-a263-4741-ad0b-6b85c50632a6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:23.361210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df8aac13-a263-4741-ad0b-6b85c50632a6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:23.361856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-df8aac13-a263-4741-ad0b-6b85c50632a6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:23.516246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-df8aac13-a263-4741-ad0b-6b85c50632a6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 20997 microversion: 2.20 time: 0.177696 Apr 20 19:34:23.516983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 409/760] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:23 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 20997 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:34:24.071040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:34:24.071838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:34:24.072398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:34:24.072917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:34:24.073396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:34:24.083047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:24.083396 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:24.084805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:24.085538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:24.109035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:34:24.113146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Getting quotas for user 998b5783d8804bfa8d4a1c016b5666be and project ca2fcc0eb6e6446fb2f6b877d41b57d1. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:34:24.125205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:34:24.128007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ecb0ecb7-c94b-49ab-bdd2-704b98b89e2e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:34:24.212060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-63164956-c2a4-4a0e-b82d-c2ce7f066e42 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.030233 Apr 20 19:34:24.213114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 352/761] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:34:23 2021] POST /compute/v2.1/servers => generated 401 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 19:34:24.226445 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2de150c5-be40-4f1f-9836-7c26ff97d7bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:24.226988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2de150c5-be40-4f1f-9836-7c26ff97d7bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:24.245789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:24.249053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:24.267458 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:24.280887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:24.282485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:24.283488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:24.331489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2de150c5-be40-4f1f-9836-7c26ff97d7bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:24.344260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2de150c5-be40-4f1f-9836-7c26ff97d7bd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1237 microversion: 2.1 time: 0.123926 Apr 20 19:34:24.350156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 410/762] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:24 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:24.527922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7f94ffe2-f096-4767-a880-1d85c4365e94 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:24.529318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7f94ffe2-f096-4767-a880-1d85c4365e94 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:24.573062 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f94ffe2-f096-4767-a880-1d85c4365e94 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:24.581520 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f94ffe2-f096-4767-a880-1d85c4365e94 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:24.585811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f94ffe2-f096-4767-a880-1d85c4365e94 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:24.586651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f94ffe2-f096-4767-a880-1d85c4365e94 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:24.795137 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7f94ffe2-f096-4767-a880-1d85c4365e94 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 22981 microversion: 2.20 time: 0.270947 Apr 20 19:34:24.795945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 411/763] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:24 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 22981 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:25.028555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:25.039791 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c998662-8167-4b60-b89a-8c1aeecbea78 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1502 microversion: 2.1 time: 0.801211 Apr 20 19:34:25.044350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 353/764] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:24 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1502 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:25.363878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:25.365440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:25.374758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:25.375501 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:25.376524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:25.377366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:25.551728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:25.564815 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cec54d1c-6f6d-4f8e-9524-f072fdba07ba tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1289 microversion: 2.1 time: 0.205301 Apr 20 19:34:25.566256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 412/765] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:25 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1289 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:25.809310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9deacf2f-2b27-41df-8579-6ebf9ad8c4e3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:25.814295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9deacf2f-2b27-41df-8579-6ebf9ad8c4e3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:25.826961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9deacf2f-2b27-41df-8579-6ebf9ad8c4e3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:25.828263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9deacf2f-2b27-41df-8579-6ebf9ad8c4e3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:25.830111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9deacf2f-2b27-41df-8579-6ebf9ad8c4e3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:25.830614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9deacf2f-2b27-41df-8579-6ebf9ad8c4e3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:26.062430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:26.067344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:26.083506 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:26.084371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:26.085428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:26.086128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:26.235187 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9deacf2f-2b27-41df-8579-6ebf9ad8c4e3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 24400 microversion: 2.20 time: 0.431412 Apr 20 19:34:26.247093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 354/766] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:25 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 24400 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:26.257175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-7ca81a89-c50e-47aa-a3f1-617bd3c633e8 req-79d11d55-c71e-46cc-b0b8-c51146729434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f8f2c1-a94c-40db-970e-735e1181f265", "name": "network-vif-deleted", "tag": "0102065e-8eff-4774-a05a-016694bb90d2"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:26.266379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:26.266379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:26.290011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7ca81a89-c50e-47aa-a3f1-617bd3c633e8 req-79d11d55-c71e-46cc-b0b8-c51146729434 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:26.290610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7ca81a89-c50e-47aa-a3f1-617bd3c633e8 req-79d11d55-c71e-46cc-b0b8-c51146729434 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:26.311641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-7ca81a89-c50e-47aa-a3f1-617bd3c633e8 req-79d11d55-c71e-46cc-b0b8-c51146729434 service nova] Creating event network-vif-deleted:0102065e-8eff-4774-a05a-016694bb90d2 for instance 47f8f2c1-a94c-40db-970e-735e1181f265 on hv-cinder-78726 Apr 20 19:34:26.334290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-7ca81a89-c50e-47aa-a3f1-617bd3c633e8 req-79d11d55-c71e-46cc-b0b8-c51146729434 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084671 Apr 20 19:34:26.335386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 355/767] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:26.368655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe860dd9674242548283666ef51b333c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b12492e3c4c5494ee0cc799b046cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:26.378730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-64dd6639-f8c2-4dd6-a1c4-f401ab3517e6 tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 200 len: 1460 microversion: 2.1 time: 0.320934 Apr 20 19:34:26.382633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 413/768] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:26 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 1460 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:26.585344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:26.586234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:26.597502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:26.598018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:26.598878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:26.599364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:26.733509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:26.743623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-169249d3-44e5-46ea-8e19-d068785512d3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1295 microversion: 2.1 time: 0.163156 Apr 20 19:34:26.744280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 356/769] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:26 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:27.258441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdef6ffe-a3fa-482d-aba4-30e33c4bf3b0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:27.259475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fdef6ffe-a3fa-482d-aba4-30e33c4bf3b0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:27.269168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdef6ffe-a3fa-482d-aba4-30e33c4bf3b0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:27.269909 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdef6ffe-a3fa-482d-aba4-30e33c4bf3b0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:27.270779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdef6ffe-a3fa-482d-aba4-30e33c4bf3b0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:27.271282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdef6ffe-a3fa-482d-aba4-30e33c4bf3b0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:27.401349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:27.409744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] [instance: 47f8f2c1-a94c-40db-970e-735e1181f265] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:27.409982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fdef6ffe-a3fa-482d-aba4-30e33c4bf3b0 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 25757 microversion: 2.20 time: 0.155270 Apr 20 19:34:27.419517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 414/770] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:27 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 25757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:27.441170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:27.441866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:27.442858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:27.443468 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:27.502157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] HTTP exception thrown: Instance 47f8f2c1-a94c-40db-970e-735e1181f265 could not be found. Apr 20 19:34:27.502844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] Returning 404 to user: Instance 47f8f2c1-a94c-40db-970e-735e1181f265 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:34:27.503773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c031d800-0096-48d7-bf96-d2d1582160ed tempest-VolumesActionsTest-101133609 tempest-VolumesActionsTest-101133609-project] 10.222.0.38 "GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265" status: 404 len: 111 microversion: 2.1 time: 0.107433 Apr 20 19:34:27.504388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 357/771] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:27 2021] GET /compute/v2.1/servers/47f8f2c1-a94c-40db-970e-735e1181f265 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:34:27.763716 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:27.765776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:27.783820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:27.785801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:27.787341 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:27.788145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:28.085320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:28.103782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4e145983-b2a7-495d-b3b8-3af54db3d1b6 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.345216 Apr 20 19:34:28.105255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 415/772] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:27 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:28.326028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-0f020df3-6b39-44fa-b597-6f05ff6122dd req-52e83d11-e585-4c60-a984-6337443d4a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa4727d-dc25-4f4e-91ad-32dffa17a241", "tag": "75aa08dc-b593-4a52-a8d8-8a5392fa4f68"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:28.327854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:28.327854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:28.358878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0f020df3-6b39-44fa-b597-6f05ff6122dd req-52e83d11-e585-4c60-a984-6337443d4a71 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:28.359877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0f020df3-6b39-44fa-b597-6f05ff6122dd req-52e83d11-e585-4c60-a984-6337443d4a71 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:28.385453 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-0f020df3-6b39-44fa-b597-6f05ff6122dd req-52e83d11-e585-4c60-a984-6337443d4a71 service nova] Creating event network-changed:75aa08dc-b593-4a52-a8d8-8a5392fa4f68 for instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 on hv-cinder-78726 Apr 20 19:34:28.409343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-0f020df3-6b39-44fa-b597-6f05ff6122dd req-52e83d11-e585-4c60-a984-6337443d4a71 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208431 Apr 20 19:34:28.413730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 358/773] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:28.429811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc3df701-8ec9-4d28-b9bc-41093d5544c1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:28.431098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc3df701-8ec9-4d28-b9bc-41093d5544c1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:28.460620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc3df701-8ec9-4d28-b9bc-41093d5544c1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:28.461153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc3df701-8ec9-4d28-b9bc-41093d5544c1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:28.462169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc3df701-8ec9-4d28-b9bc-41093d5544c1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:28.462667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc3df701-8ec9-4d28-b9bc-41093d5544c1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:28.666858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc3df701-8ec9-4d28-b9bc-41093d5544c1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 26946 microversion: 2.20 time: 0.246723 Apr 20 19:34:28.669698 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 416/774] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:28 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 26946 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:29.127163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:29.127946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:29.136226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:29.136759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:29.137602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:29.138097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:29.365501 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:29.374474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30e2897a-9d95-4dc7-afc9-d76a8894a898 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.252572 Apr 20 19:34:29.375093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 359/775] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:29 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:29.684578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25f588ae-7f4b-4762-bad6-1aeab6b49781 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:29.685753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-25f588ae-7f4b-4762-bad6-1aeab6b49781 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:29.694288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f588ae-7f4b-4762-bad6-1aeab6b49781 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:29.694797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f588ae-7f4b-4762-bad6-1aeab6b49781 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:29.695629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f588ae-7f4b-4762-bad6-1aeab6b49781 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:29.696119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25f588ae-7f4b-4762-bad6-1aeab6b49781 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:30.393270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:30.394186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:30.402738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:30.403256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:30.404181 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:30.405482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:30.623647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:30.632420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-63088709-ed6d-4493-97bb-b3bb2a87ea5f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.244298 Apr 20 19:34:30.633110 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 360/776] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:30 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:31.655191 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:31.655902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:31.663961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:31.664476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:31.665347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:31.665848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:31.889619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:31.898233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ccad5b28-5f0f-47c1-a3fa-1c6f53fc6d9c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.247733 Apr 20 19:34:31.898851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 361/777] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:31 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:34:32.437957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-25f588ae-7f4b-4762-bad6-1aeab6b49781 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 27815 microversion: 2.20 time: 2.757028 Apr 20 19:34:32.443308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 417/778] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:29 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 27815 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:32.916895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:32.917544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:32.926014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:32.926523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:32.927405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:32.927905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:33.145112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:33.154710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5343acb6-d2d1-4a56-98b9-2cd7ec5a1d3f tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.241446 Apr 20 19:34:33.155658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 362/779] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:32 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:33.452169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3479928d-e246-4886-b10b-b51a771a75ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:33.453279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3479928d-e246-4886-b10b-b51a771a75ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:33.461953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3479928d-e246-4886-b10b-b51a771a75ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:33.462464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3479928d-e246-4886-b10b-b51a771a75ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:33.463305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3479928d-e246-4886-b10b-b51a771a75ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:33.463804 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3479928d-e246-4886-b10b-b51a771a75ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:33.632431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3479928d-e246-4886-b10b-b51a771a75ed tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28176 microversion: 2.20 time: 0.185126 Apr 20 19:34:33.633465 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 418/780] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:33 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28176 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:34.186010 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:34.188455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:34.200631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:34.201472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:34.203085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:34.203801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:34.475980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:34.485846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bafba05f-d37b-43d2-97dc-5faa24e500ea tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.316225 Apr 20 19:34:34.486491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 363/781] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:34 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:34.646185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-51c6c48a-a69c-430f-8616-3e4569e79450 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:34.647633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-51c6c48a-a69c-430f-8616-3e4569e79450 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:34.656033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c6c48a-a69c-430f-8616-3e4569e79450 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:34.657169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c6c48a-a69c-430f-8616-3e4569e79450 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:34.658041 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c6c48a-a69c-430f-8616-3e4569e79450 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:34.658531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51c6c48a-a69c-430f-8616-3e4569e79450 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:34.809560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-51c6c48a-a69c-430f-8616-3e4569e79450 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28176 microversion: 2.20 time: 0.167618 Apr 20 19:34:34.812739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 419/782] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:34 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28176 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:35.503957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:35.504740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:35.512802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:35.513323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:35.514170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:35.514675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:35.747682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:35.758432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-063f6f82-4386-4192-946e-ee6c82352eac tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.258538 Apr 20 19:34:35.759133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 364/783] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:35 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:35.823826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07e79363-8f06-49cd-80a0-19bb016c35be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:35.825312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07e79363-8f06-49cd-80a0-19bb016c35be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:35.835384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07e79363-8f06-49cd-80a0-19bb016c35be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:35.835858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07e79363-8f06-49cd-80a0-19bb016c35be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:35.836734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07e79363-8f06-49cd-80a0-19bb016c35be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:35.837245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07e79363-8f06-49cd-80a0-19bb016c35be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:35.999998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07e79363-8f06-49cd-80a0-19bb016c35be tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28467 microversion: 2.20 time: 0.180054 Apr 20 19:34:36.008811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 420/784] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:35 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28467 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:36.778224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:36.778805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:36.787876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:36.788393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:36.789366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:36.789872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:37.017277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2e359c77-3de8-4772-ab15-e3426092d0e6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:37.018452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2e359c77-3de8-4772-ab15-e3426092d0e6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:37.036419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e359c77-3de8-4772-ab15-e3426092d0e6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:37.037200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e359c77-3de8-4772-ab15-e3426092d0e6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:37.038226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e359c77-3de8-4772-ab15-e3426092d0e6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:37.038882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2e359c77-3de8-4772-ab15-e3426092d0e6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:37.059926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:37.079937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a8f1df17-0bad-4ee1-9207-4767351c742a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.305966 Apr 20 19:34:37.089966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 365/785] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:36 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:37.204660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2e359c77-3de8-4772-ab15-e3426092d0e6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28635 microversion: 2.20 time: 0.192130 Apr 20 19:34:37.205404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 421/786] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:37 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28635 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:38.098885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:38.100155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:38.108393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:38.109533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:38.110384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:38.110883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:38.218645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b3903b33-bc90-4306-af9e-18b711bf3918 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:38.220134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b3903b33-bc90-4306-af9e-18b711bf3918 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:38.229480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3903b33-bc90-4306-af9e-18b711bf3918 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:38.230293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3903b33-bc90-4306-af9e-18b711bf3918 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:38.231361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3903b33-bc90-4306-af9e-18b711bf3918 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:38.232050 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3903b33-bc90-4306-af9e-18b711bf3918 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:38.348614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:38.360411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-397b8e84-66d2-4c17-b03c-04d594f796d7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.264502 Apr 20 19:34:38.364763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 366/787] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:38 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:38.367926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b3903b33-bc90-4306-af9e-18b711bf3918 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28635 microversion: 2.20 time: 0.154438 Apr 20 19:34:38.369121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 422/788] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:38 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28635 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:34:38.694123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-9035e978-f01e-4e1d-b6ae-a8eba5cf4dda req-8f5e7056-956e-4b47-92e7-b9bb40fd1ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa4727d-dc25-4f4e-91ad-32dffa17a241", "name": "network-vif-plugged", "status": "completed", "tag": "75aa08dc-b593-4a52-a8d8-8a5392fa4f68"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:38.695977 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:38.695977 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:38.706914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-9035e978-f01e-4e1d-b6ae-a8eba5cf4dda req-8f5e7056-956e-4b47-92e7-b9bb40fd1ccf service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:38.707621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-9035e978-f01e-4e1d-b6ae-a8eba5cf4dda req-8f5e7056-956e-4b47-92e7-b9bb40fd1ccf service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:38.728424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-9035e978-f01e-4e1d-b6ae-a8eba5cf4dda req-8f5e7056-956e-4b47-92e7-b9bb40fd1ccf service nova] Creating event network-vif-plugged:75aa08dc-b593-4a52-a8d8-8a5392fa4f68 for instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 on hv-cinder-78726 Apr 20 19:34:38.750028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-9035e978-f01e-4e1d-b6ae-a8eba5cf4dda req-8f5e7056-956e-4b47-92e7-b9bb40fd1ccf service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133053 Apr 20 19:34:38.750841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 367/789] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:39.381877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:39.382429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f07703c9-b2a3-45dc-9c59-d66e376bec31 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:39.383493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:39.383664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f07703c9-b2a3-45dc-9c59-d66e376bec31 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:39.391829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:39.392199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07703c9-b2a3-45dc-9c59-d66e376bec31 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:39.392332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:39.393094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07703c9-b2a3-45dc-9c59-d66e376bec31 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:39.393234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:39.393682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:39.394076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07703c9-b2a3-45dc-9c59-d66e376bec31 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:39.394569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f07703c9-b2a3-45dc-9c59-d66e376bec31 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:39.633689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f07703c9-b2a3-45dc-9c59-d66e376bec31 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28635 microversion: 2.20 time: 0.255817 Apr 20 19:34:39.636807 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:39.641462 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 423/790] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:39 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28635 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:39.649321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60ad609a-3871-4f5c-98fd-92997cb605f5 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1362 microversion: 2.1 time: 0.271675 Apr 20 19:34:39.650285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 368/791] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:39 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:40.652634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b21e31f3-005d-4fa3-ab78-749e6da91580 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:40.653822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b21e31f3-005d-4fa3-ab78-749e6da91580 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:40.663389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b21e31f3-005d-4fa3-ab78-749e6da91580 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:40.668962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:40.669934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:40.674164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b21e31f3-005d-4fa3-ab78-749e6da91580 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:40.677537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b21e31f3-005d-4fa3-ab78-749e6da91580 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:40.678311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b21e31f3-005d-4fa3-ab78-749e6da91580 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:40.681951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:40.690733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:40.693028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:40.693630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:40.886356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b21e31f3-005d-4fa3-ab78-749e6da91580 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28635 microversion: 2.20 time: 0.238024 Apr 20 19:34:40.887381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 424/792] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:40 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28635 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:40.986115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:40.996225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f7eb6300-bc2a-430a-9a65-d5b5c2a2fcad tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1548 microversion: 2.1 time: 0.331081 Apr 20 19:34:40.996804 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 369/793] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:40 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1548 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:41.018271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9902f4b7-d391-40d1-9d39-1797252c2fca tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:41.019247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9902f4b7-d391-40d1-9d39-1797252c2fca tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:41.028114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9902f4b7-d391-40d1-9d39-1797252c2fca tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:41.028654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9902f4b7-d391-40d1-9d39-1797252c2fca tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:41.029584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9902f4b7-d391-40d1-9d39-1797252c2fca tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:41.030413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9902f4b7-d391-40d1-9d39-1797252c2fca tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:41.206879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9902f4b7-d391-40d1-9d39-1797252c2fca tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193316 Apr 20 19:34:41.222301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 425/794] 10.222.0.38 () {58 vars in 1265 bytes} [Tue Apr 20 19:34:41 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:41.899763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-993a6135-8ad6-4cb2-806a-32265b235295 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:41.901500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-993a6135-8ad6-4cb2-806a-32265b235295 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:41.914552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993a6135-8ad6-4cb2-806a-32265b235295 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:41.918121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993a6135-8ad6-4cb2-806a-32265b235295 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:41.919175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993a6135-8ad6-4cb2-806a-32265b235295 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:41.919854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-993a6135-8ad6-4cb2-806a-32265b235295 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:42.063873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-993a6135-8ad6-4cb2-806a-32265b235295 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 28635 microversion: 2.20 time: 0.168085 Apr 20 19:34:42.065094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 370/795] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:41 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 28635 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:43.086593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f3f24476-815b-44ed-bc28-d77d78986556 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:43.087799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f3f24476-815b-44ed-bc28-d77d78986556 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:43.099580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3f24476-815b-44ed-bc28-d77d78986556 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:43.100242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3f24476-815b-44ed-bc28-d77d78986556 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:43.101220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3f24476-815b-44ed-bc28-d77d78986556 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:43.101931 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f3f24476-815b-44ed-bc28-d77d78986556 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:43.266827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f3f24476-815b-44ed-bc28-d77d78986556 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 29804 microversion: 2.20 time: 0.194732 Apr 20 19:34:43.267852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 426/796] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:43 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 29804 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:43.503694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-abd12d67-56d9-413f-9316-bedd2e26b5c2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:43.504892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-abd12d67-56d9-413f-9316-bedd2e26b5c2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:43.521346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-1992833a-7a08-42f5-8e00-3cc16e8b8a01 req-73ca4499-991e-4ee5-9f5f-525162ca8a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa4727d-dc25-4f4e-91ad-32dffa17a241", "tag": "75aa08dc-b593-4a52-a8d8-8a5392fa4f68"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:43.523030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:43.523030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:43.531304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abd12d67-56d9-413f-9316-bedd2e26b5c2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:43.532289 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abd12d67-56d9-413f-9316-bedd2e26b5c2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:43.533201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abd12d67-56d9-413f-9316-bedd2e26b5c2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:43.533704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abd12d67-56d9-413f-9316-bedd2e26b5c2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:43.543365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-1992833a-7a08-42f5-8e00-3cc16e8b8a01 req-73ca4499-991e-4ee5-9f5f-525162ca8a39 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:43.543880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-1992833a-7a08-42f5-8e00-3cc16e8b8a01 req-73ca4499-991e-4ee5-9f5f-525162ca8a39 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:43.574171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-1992833a-7a08-42f5-8e00-3cc16e8b8a01 req-73ca4499-991e-4ee5-9f5f-525162ca8a39 service nova] Creating event network-changed:75aa08dc-b593-4a52-a8d8-8a5392fa4f68 for instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 on hv-cinder-78726 Apr 20 19:34:43.590700 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-1992833a-7a08-42f5-8e00-3cc16e8b8a01 req-73ca4499-991e-4ee5-9f5f-525162ca8a39 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073597 Apr 20 19:34:43.591380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 427/797] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:34:43.704959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-abd12d67-56d9-413f-9316-bedd2e26b5c2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.205523 Apr 20 19:34:43.709261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 371/798] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:43 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:34:44.282243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f882240f-dbe2-443e-be0c-eeb317546446 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:44.283780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f882240f-dbe2-443e-be0c-eeb317546446 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:44.304627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f882240f-dbe2-443e-be0c-eeb317546446 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:44.307671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f882240f-dbe2-443e-be0c-eeb317546446 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:44.309164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f882240f-dbe2-443e-be0c-eeb317546446 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:44.310551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f882240f-dbe2-443e-be0c-eeb317546446 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:44.472887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f882240f-dbe2-443e-be0c-eeb317546446 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 31501 microversion: 2.20 time: 0.196730 Apr 20 19:34:44.477085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 428/799] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:44 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 31501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:44.718755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f162b630-4c17-4335-81b1-818a49f57224 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:44.721515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f162b630-4c17-4335-81b1-818a49f57224 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:44.744654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f162b630-4c17-4335-81b1-818a49f57224 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:44.745475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f162b630-4c17-4335-81b1-818a49f57224 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:44.747233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f162b630-4c17-4335-81b1-818a49f57224 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:44.748444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f162b630-4c17-4335-81b1-818a49f57224 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:44.934340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f162b630-4c17-4335-81b1-818a49f57224 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.219953 Apr 20 19:34:44.938358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 372/800] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:44 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:34:45.337189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1224927362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1537066604", "security_groups": [{"name": "tempest-secgroup-smoke-1239683824"}], "networks": [{"uuid": "b60f85b0-c0a3-4824-a200-b37680750ba5"}], "block_device_mapping_v2": [{"uuid": "ebe95feb-3882-4dd8-a33f-76f77cb09bb7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:45.487667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb15e55c-120a-484d-a671-2fd6143c77fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:45.508516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb15e55c-120a-484d-a671-2fd6143c77fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:45.518602 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb15e55c-120a-484d-a671-2fd6143c77fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:45.519060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb15e55c-120a-484d-a671-2fd6143c77fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:45.519936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb15e55c-120a-484d-a671-2fd6143c77fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:45.520466 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb15e55c-120a-484d-a671-2fd6143c77fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:45.610341 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] validate_networks() for [('b60f85b0-c0a3-4824-a200-b37680750ba5', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:34:45.661399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb15e55c-120a-484d-a671-2fd6143c77fc tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 32722 microversion: 2.20 time: 0.178517 Apr 20 19:34:45.662350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 373/801] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:45 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 32722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:45.951980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-13a88bb0-69f1-447c-a002-2b3600b4e547 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:45.957091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-13a88bb0-69f1-447c-a002-2b3600b4e547 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:45.981556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a88bb0-69f1-447c-a002-2b3600b4e547 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:45.982866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a88bb0-69f1-447c-a002-2b3600b4e547 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:45.984920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a88bb0-69f1-447c-a002-2b3600b4e547 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:45.986012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-13a88bb0-69f1-447c-a002-2b3600b4e547 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:46.149432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-13a88bb0-69f1-447c-a002-2b3600b4e547 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.205129 Apr 20 19:34:46.153255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 374/802] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:45 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 19:34:46.463855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:34:46.464959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:34:46.465685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:34:46.466318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:34:46.466951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:34:46.479345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:46.480091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:46.481265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:46.482177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:46.504939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Getting quotas for project ba7e670538c341e6a378232973d1ccde. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:34:46.509588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Getting quotas for user 22a8daafdd5147a9a0b726981c16cabe and project ba7e670538c341e6a378232973d1ccde. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:34:46.631239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:34:46.633856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebe95feb-3882-4dd8-a33f-76f77cb09bb7',volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:34:46.677612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0fc808f7-5698-49cc-bbf2-93ff52b941b5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:46.677612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0fc808f7-5698-49cc-bbf2-93ff52b941b5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:46.687470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0fc808f7-5698-49cc-bbf2-93ff52b941b5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:46.688084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0fc808f7-5698-49cc-bbf2-93ff52b941b5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:46.688997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0fc808f7-5698-49cc-bbf2-93ff52b941b5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:46.689480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0fc808f7-5698-49cc-bbf2-93ff52b941b5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:46.841379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4875442e-c45b-41f5-bde3-966461ccd454 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.507197 Apr 20 19:34:46.842103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0fc808f7-5698-49cc-bbf2-93ff52b941b5 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 33516 microversion: 2.20 time: 0.171372 Apr 20 19:34:46.843016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 429/803] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:34:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:34:46.848180 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 375/804] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:46 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 33516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:34:46.855102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-87e7a424-5a10-4dad-bd16-615eef6d3660 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:46.855961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-87e7a424-5a10-4dad-bd16-615eef6d3660 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:46.961487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-87e7a424-5a10-4dad-bd16-615eef6d3660 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:46.976145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-87e7a424-5a10-4dad-bd16-615eef6d3660 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1089 microversion: 2.1 time: 0.125480 Apr 20 19:34:46.977101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 430/805] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:46 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1089 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:47.163399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-521dfdc1-67bd-4e59-af25-ba8ca4ffb5cc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:47.164551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-521dfdc1-67bd-4e59-af25-ba8ca4ffb5cc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:47.174569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-521dfdc1-67bd-4e59-af25-ba8ca4ffb5cc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:47.175349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-521dfdc1-67bd-4e59-af25-ba8ca4ffb5cc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:47.176533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-521dfdc1-67bd-4e59-af25-ba8ca4ffb5cc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:47.177199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-521dfdc1-67bd-4e59-af25-ba8ca4ffb5cc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:47.316479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-521dfdc1-67bd-4e59-af25-ba8ca4ffb5cc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.157268 Apr 20 19:34:47.317679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 376/806] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:47 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:34:47.859269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b389e16e-b6ca-4cce-9a85-fd2a9eeb19f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:47.861398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b389e16e-b6ca-4cce-9a85-fd2a9eeb19f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:47.873578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b389e16e-b6ca-4cce-9a85-fd2a9eeb19f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:47.875329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b389e16e-b6ca-4cce-9a85-fd2a9eeb19f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:47.876689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b389e16e-b6ca-4cce-9a85-fd2a9eeb19f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:47.878545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b389e16e-b6ca-4cce-9a85-fd2a9eeb19f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:47.999998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:48.002184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:48.018734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:48.019362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:48.020627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:48.021278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:48.029872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b389e16e-b6ca-4cce-9a85-fd2a9eeb19f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 34429 microversion: 2.20 time: 0.177464 Apr 20 19:34:48.030819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 431/807] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:47 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 34429 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:48.179272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:48.194901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f5c11fc0-8752-4096-a32c-16e9e99a22f8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1187 microversion: 2.1 time: 0.203443 Apr 20 19:34:48.195389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 377/808] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:47 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1187 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:48.328820 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2dc96c32-1196-4385-afa8-f778b24bd060 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:48.329990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2dc96c32-1196-4385-afa8-f778b24bd060 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:48.351525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2dc96c32-1196-4385-afa8-f778b24bd060 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:48.353483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2dc96c32-1196-4385-afa8-f778b24bd060 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:48.354512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2dc96c32-1196-4385-afa8-f778b24bd060 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:48.355165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2dc96c32-1196-4385-afa8-f778b24bd060 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:48.532774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2dc96c32-1196-4385-afa8-f778b24bd060 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.208248 Apr 20 19:34:48.533402 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 432/809] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:48 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:34:49.042909 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c2377b72-98fb-4b35-8d42-49afd83ca452 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:49.044696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c2377b72-98fb-4b35-8d42-49afd83ca452 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:49.053529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2377b72-98fb-4b35-8d42-49afd83ca452 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:49.054123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2377b72-98fb-4b35-8d42-49afd83ca452 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:49.055043 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2377b72-98fb-4b35-8d42-49afd83ca452 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:49.055608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c2377b72-98fb-4b35-8d42-49afd83ca452 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:49.193490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c2377b72-98fb-4b35-8d42-49afd83ca452 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 35530 microversion: 2.20 time: 0.154427 Apr 20 19:34:49.197714 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 378/810] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:49 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 35530 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:49.226133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:49.226996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:49.237347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:49.237866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:49.238725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:49.239225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:49.545822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e7d57943-9325-4bd8-9cd3-0d5ff985222a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:49.547187 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e7d57943-9325-4bd8-9cd3-0d5ff985222a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:49.559144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:49.570216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ce3833b6-0fc2-467c-aead-75c34f60f906 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1273 microversion: 2.1 time: 0.348434 Apr 20 19:34:49.570666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7d57943-9325-4bd8-9cd3-0d5ff985222a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:49.571302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7d57943-9325-4bd8-9cd3-0d5ff985222a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:49.574803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7d57943-9325-4bd8-9cd3-0d5ff985222a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:49.579537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e7d57943-9325-4bd8-9cd3-0d5ff985222a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:49.582166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 433/811] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:49 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1273 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:49.758371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e7d57943-9325-4bd8-9cd3-0d5ff985222a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.217406 Apr 20 19:34:49.768478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 379/812] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:49 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:34:50.208775 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1ec4dbe7-d6b2-4dcd-869b-dd00f374a67e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:50.210452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1ec4dbe7-d6b2-4dcd-869b-dd00f374a67e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:50.223053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec4dbe7-d6b2-4dcd-869b-dd00f374a67e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:50.223830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec4dbe7-d6b2-4dcd-869b-dd00f374a67e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:50.224948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec4dbe7-d6b2-4dcd-869b-dd00f374a67e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:50.226123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1ec4dbe7-d6b2-4dcd-869b-dd00f374a67e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:50.435611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1ec4dbe7-d6b2-4dcd-869b-dd00f374a67e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 36931 microversion: 2.20 time: 0.232745 Apr 20 19:34:50.443314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 434/813] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:50 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 36931 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:50.596840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:50.599591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:50.613080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:50.613859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:50.614915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:50.615672 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:50.779664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-16a0870f-1cfa-46c0-954d-e82f668ae7fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:50.782109 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-16a0870f-1cfa-46c0-954d-e82f668ae7fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:50.797726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16a0870f-1cfa-46c0-954d-e82f668ae7fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:50.798823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16a0870f-1cfa-46c0-954d-e82f668ae7fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:50.799399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16a0870f-1cfa-46c0-954d-e82f668ae7fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:50.799859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16a0870f-1cfa-46c0-954d-e82f668ae7fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:50.912058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:50.921193 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c1bf8dc1-55c6-4c3f-bb2c-7aac3ba00ab4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.333949 Apr 20 19:34:50.922723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 380/814] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:50 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:50.927404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-8b1c1c81-6186-499d-ac1b-92659e559f29 req-36c81b41-c2a7-41da-bc19-3dcd56a30525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f0c78d-b4ea-45e9-8304-c38a70bb2490", "tag": "076208ee-e3f1-45f9-b986-47a5b26317b8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:50.929784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:34:50.929784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:34:50.940143 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8b1c1c81-6186-499d-ac1b-92659e559f29 req-36c81b41-c2a7-41da-bc19-3dcd56a30525 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:50.940645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-8b1c1c81-6186-499d-ac1b-92659e559f29 req-36c81b41-c2a7-41da-bc19-3dcd56a30525 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:50.962954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-8b1c1c81-6186-499d-ac1b-92659e559f29 req-36c81b41-c2a7-41da-bc19-3dcd56a30525 service nova] Creating event network-changed:076208ee-e3f1-45f9-b986-47a5b26317b8 for instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 on hv-cinder-78726 Apr 20 19:34:50.969975 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-8b1c1c81-6186-499d-ac1b-92659e559f29 req-36c81b41-c2a7-41da-bc19-3dcd56a30525 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045903 Apr 20 19:34:50.971627 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 381/815] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:34:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:34:51.003615 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-16a0870f-1cfa-46c0-954d-e82f668ae7fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.230882 Apr 20 19:34:51.007464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 435/816] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:50 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 19:34:51.452000 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-33766d3e-704e-49e4-8fc6-321705a71768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:51.453477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-33766d3e-704e-49e4-8fc6-321705a71768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:51.470375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33766d3e-704e-49e4-8fc6-321705a71768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:51.471708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33766d3e-704e-49e4-8fc6-321705a71768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:51.472599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33766d3e-704e-49e4-8fc6-321705a71768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:51.474949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-33766d3e-704e-49e4-8fc6-321705a71768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:51.623493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-33766d3e-704e-49e4-8fc6-321705a71768 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 38064 microversion: 2.20 time: 0.175901 Apr 20 19:34:51.626339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 382/817] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:51 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 38064 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:51.941865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:51.942588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:51.951557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:51.952105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:51.953152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:51.953662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:52.017738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-816f7c3e-0e28-496c-bfe6-f1f46f951002 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:52.018949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-816f7c3e-0e28-496c-bfe6-f1f46f951002 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:52.042020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-816f7c3e-0e28-496c-bfe6-f1f46f951002 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:52.042624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-816f7c3e-0e28-496c-bfe6-f1f46f951002 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:52.068036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-816f7c3e-0e28-496c-bfe6-f1f46f951002 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:52.068570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-816f7c3e-0e28-496c-bfe6-f1f46f951002 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:52.233108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:52.244693 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dd5bbb3e-aa28-4a69-af4b-29b1a534b4fc tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.308553 Apr 20 19:34:52.245583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 436/818] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:51 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:52.251927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-816f7c3e-0e28-496c-bfe6-f1f46f951002 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.240233 Apr 20 19:34:52.252887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 383/819] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:52 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:34:52.635950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ec4180a4-edf4-48ac-ba72-eaab31e3752a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:52.637018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ec4180a4-edf4-48ac-ba72-eaab31e3752a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:52.645478 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4180a4-edf4-48ac-ba72-eaab31e3752a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:52.645987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4180a4-edf4-48ac-ba72-eaab31e3752a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:52.646837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4180a4-edf4-48ac-ba72-eaab31e3752a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:52.647326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4180a4-edf4-48ac-ba72-eaab31e3752a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:52.806813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ec4180a4-edf4-48ac-ba72-eaab31e3752a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 38191 microversion: 2.20 time: 0.174756 Apr 20 19:34:52.807652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 437/820] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:52 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 38191 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:53.263744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:53.264293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-70d71fe8-4158-4406-9bcf-cbba1d1c441c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:53.264573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:53.266306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-70d71fe8-4158-4406-9bcf-cbba1d1c441c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:53.274082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:53.274593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:53.274987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70d71fe8-4158-4406-9bcf-cbba1d1c441c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:53.275444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:53.275556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70d71fe8-4158-4406-9bcf-cbba1d1c441c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:53.275948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:53.276350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70d71fe8-4158-4406-9bcf-cbba1d1c441c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:53.276866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-70d71fe8-4158-4406-9bcf-cbba1d1c441c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:53.404636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-70d71fe8-4158-4406-9bcf-cbba1d1c441c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.144526 Apr 20 19:34:53.408783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 438/821] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:53 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 19:34:53.494298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:53.504018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-236f05a2-f53e-44a7-9b38-72287e81fe8b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.244899 Apr 20 19:34:53.504642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 384/822] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:53 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:53.821128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-56df8cc5-16a7-4957-b913-25ee60b01b05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:53.822272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-56df8cc5-16a7-4957-b913-25ee60b01b05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:53.831698 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56df8cc5-16a7-4957-b913-25ee60b01b05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:53.832253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56df8cc5-16a7-4957-b913-25ee60b01b05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:53.833124 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56df8cc5-16a7-4957-b913-25ee60b01b05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:53.833621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-56df8cc5-16a7-4957-b913-25ee60b01b05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:53.965657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-56df8cc5-16a7-4957-b913-25ee60b01b05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 38191 microversion: 2.20 time: 0.149459 Apr 20 19:34:53.966578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 439/823] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:53 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 38191 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:54.416530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-14e7c38f-6e13-4d58-9c47-e29f3082000c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:54.417655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-14e7c38f-6e13-4d58-9c47-e29f3082000c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:54.426238 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14e7c38f-6e13-4d58-9c47-e29f3082000c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:54.426744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14e7c38f-6e13-4d58-9c47-e29f3082000c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:54.427600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14e7c38f-6e13-4d58-9c47-e29f3082000c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:54.428124 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-14e7c38f-6e13-4d58-9c47-e29f3082000c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:54.523177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:54.523951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:54.533263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:54.533774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:54.534622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:54.535117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:54.567028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-14e7c38f-6e13-4d58-9c47-e29f3082000c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 14 microversion: 2.1 time: 0.154011 Apr 20 19:34:54.570616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 385/824] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:54 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:34:54.758689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:54.767640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b124c01d-1cf6-4dbf-9fda-ece3664f661e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.249019 Apr 20 19:34:54.768266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 440/825] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:54 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:34:54.980150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-008504af-14fc-40ed-a4e9-47eaff922d92 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:54.981278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-008504af-14fc-40ed-a4e9-47eaff922d92 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:54.990155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008504af-14fc-40ed-a4e9-47eaff922d92 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:54.990670 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008504af-14fc-40ed-a4e9-47eaff922d92 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:54.991531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008504af-14fc-40ed-a4e9-47eaff922d92 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:54.992032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-008504af-14fc-40ed-a4e9-47eaff922d92 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:55.133161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-008504af-14fc-40ed-a4e9-47eaff922d92 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 38194 microversion: 2.20 time: 0.157624 Apr 20 19:34:55.133860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 386/826] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:54 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 38194 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:34:55.579704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-00412ee4-fb9b-4b7d-b6fb-d4de4f10326d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:55.580777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-00412ee4-fb9b-4b7d-b6fb-d4de4f10326d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:55.589365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00412ee4-fb9b-4b7d-b6fb-d4de4f10326d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:55.590309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00412ee4-fb9b-4b7d-b6fb-d4de4f10326d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:55.591280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00412ee4-fb9b-4b7d-b6fb-d4de4f10326d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:55.591785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-00412ee4-fb9b-4b7d-b6fb-d4de4f10326d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:55.787386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:55.788209 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:55.798814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:55.799317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:55.800163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:55.800656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:55.871197 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-00412ee4-fb9b-4b7d-b6fb-d4de4f10326d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 12971 microversion: 2.1 time: 0.296213 Apr 20 19:34:55.872765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 441/827] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:55 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 12971 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:34:56.023799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:56.034189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e2d10213-1def-4a1d-b7dc-30e3db105a5b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.251364 Apr 20 19:34:56.034859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 387/828] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:55 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:34:56.147091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b37a6d6c-b215-4a7b-a411-f9c318ec89c6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:56.148273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b37a6d6c-b215-4a7b-a411-f9c318ec89c6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:56.158351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37a6d6c-b215-4a7b-a411-f9c318ec89c6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:56.158861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37a6d6c-b215-4a7b-a411-f9c318ec89c6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:56.159729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37a6d6c-b215-4a7b-a411-f9c318ec89c6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:56.160231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b37a6d6c-b215-4a7b-a411-f9c318ec89c6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:56.294414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b37a6d6c-b215-4a7b-a411-f9c318ec89c6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 200 len: 38334 microversion: 2.20 time: 0.151933 Apr 20 19:34:56.300655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 442/829] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:56 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 38334 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:34:56.306272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-51f41508-c94b-4c4f-8f68-e17d56f2c597 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:56.306829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-51f41508-c94b-4c4f-8f68-e17d56f2c597 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:56.314801 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51f41508-c94b-4c4f-8f68-e17d56f2c597 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:56.315314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51f41508-c94b-4c4f-8f68-e17d56f2c597 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:56.316192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51f41508-c94b-4c4f-8f68-e17d56f2c597 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:56.316671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-51f41508-c94b-4c4f-8f68-e17d56f2c597 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:56.378674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-51f41508-c94b-4c4f-8f68-e17d56f2c597 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/ips" status: 200 len: 152 microversion: 2.20 time: 0.076423 Apr 20 19:34:56.379317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 388/830] 10.222.0.38 () {60 vars in 1279 bytes} [Tue Apr 20 19:34:56 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/ips => generated 152 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:34:56.886023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b7f6d7be-720b-48d2-a6c8-8baa15b6cf33 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:56.887311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b7f6d7be-720b-48d2-a6c8-8baa15b6cf33 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:56.897516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7f6d7be-720b-48d2-a6c8-8baa15b6cf33 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:56.898048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7f6d7be-720b-48d2-a6c8-8baa15b6cf33 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:56.898959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7f6d7be-720b-48d2-a6c8-8baa15b6cf33 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:56.899496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b7f6d7be-720b-48d2-a6c8-8baa15b6cf33 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:57.037964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b7f6d7be-720b-48d2-a6c8-8baa15b6cf33 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 18561 microversion: 2.1 time: 0.156563 Apr 20 19:34:57.041913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 443/831] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:56 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 18561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:34:57.052192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:57.053067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:57.061608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:57.062215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:57.063751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:57.064257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:57.285761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:57.294759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1b498227-1083-4ead-adca-fa708d93e60e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.246899 Apr 20 19:34:57.295586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 389/832] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:57 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:58.051417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72613d8f-6cb3-416a-a411-528d08d0733d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:58.052559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72613d8f-6cb3-416a-a411-528d08d0733d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:58.061228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72613d8f-6cb3-416a-a411-528d08d0733d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:58.061681 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72613d8f-6cb3-416a-a411-528d08d0733d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:58.063165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72613d8f-6cb3-416a-a411-528d08d0733d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:58.063649 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72613d8f-6cb3-416a-a411-528d08d0733d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:58.217514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72613d8f-6cb3-416a-a411-528d08d0733d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 19342 microversion: 2.1 time: 0.171037 Apr 20 19:34:58.218220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 444/833] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:58 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 19342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:34:58.313256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:58.313904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:58.321886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:58.322399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:58.323230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:58.323721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:58.545338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:58.555306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-447f7828-8977-47e3-91d5-596ad8423022 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.246214 Apr 20 19:34:58.555926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 390/834] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:58 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:34:58.684404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:58.685130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:58.694022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:58.694529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:58.695372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:58.695871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:58.756054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lazy-loading 'flavor' on Instance uuid c3257299-ff9d-47e8-862f-5d8becad1633 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:34:59.105817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b02ce844-1f73-42d5-9ec0-238f29676813 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 202 len: 0 microversion: 2.20 time: 0.425802 Apr 20 19:34:59.106484 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 445/835] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:34:58 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:34:59.115019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:59.115690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:59.124340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:59.125422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:59.126461 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:59.126957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:59.230764 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-59dfee44-da31-42ce-a989-823c9270c5d9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:34:59.231927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-59dfee44-da31-42ce-a989-823c9270c5d9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:59.241037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59dfee44-da31-42ce-a989-823c9270c5d9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:59.241580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59dfee44-da31-42ce-a989-823c9270c5d9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:59.242413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59dfee44-da31-42ce-a989-823c9270c5d9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:59.242917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-59dfee44-da31-42ce-a989-823c9270c5d9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:59.347237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:59.356595 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:59.358397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:59.359612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e52e10cb-3a6b-4d33-98f8-2cf91b6570fe tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.248655 Apr 20 19:34:59.360218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 391/836] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:34:59 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:34:59.375850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-59dfee44-da31-42ce-a989-823c9270c5d9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 22070 microversion: 2.1 time: 0.148950 Apr 20 19:34:59.376533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 446/837] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:34:59 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 22070 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:34:59.573172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:34:59.573881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:34:59.581785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:59.582305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:59.583134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:34:59.583626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:34:59.799311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:34:59.808215 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c0660609-c57e-4e26-92ce-8b4f758cf394 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.239084 Apr 20 19:34:59.808853 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 392/838] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:34:59 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:35:00.380559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:00.381291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:00.387871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07385c92-d8fb-445c-99cc-23a9bf64a8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:00.388945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07385c92-d8fb-445c-99cc-23a9bf64a8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:00.389959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:00.390999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:00.392037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:00.392526 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:00.397800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07385c92-d8fb-445c-99cc-23a9bf64a8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:00.398311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07385c92-d8fb-445c-99cc-23a9bf64a8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:00.399154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07385c92-d8fb-445c-99cc-23a9bf64a8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:00.399648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07385c92-d8fb-445c-99cc-23a9bf64a8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:00.536301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07385c92-d8fb-445c-99cc-23a9bf64a8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 23804 microversion: 2.1 time: 0.152325 Apr 20 19:35:00.538016 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 393/839] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:00 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 23804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:35:00.616140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:00.626572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:00.628302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:00.629597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9f380533-781a-49e8-98d1-0205862200f4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.253996 Apr 20 19:35:00.630271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 447/840] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:00 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:00.826962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:00.827750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:00.844085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:00.845095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:00.846675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:00.847612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:01.070916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:01.081262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-579c3203-1051-4bdb-9a10-a8f0b63f784d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.258919 Apr 20 19:35:01.081886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 394/841] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:35:00 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:35:01.548701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cabea77c-b885-4695-89ea-10972971882b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:01.549872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cabea77c-b885-4695-89ea-10972971882b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:01.558541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cabea77c-b885-4695-89ea-10972971882b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:01.559057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cabea77c-b885-4695-89ea-10972971882b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:01.559898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cabea77c-b885-4695-89ea-10972971882b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:01.560394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cabea77c-b885-4695-89ea-10972971882b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:01.650563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:01.651285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:01.659479 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:01.659999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:01.660870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:01.661376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:01.695956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cabea77c-b885-4695-89ea-10972971882b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 24709 microversion: 2.1 time: 0.151139 Apr 20 19:35:01.700028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 448/842] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:01 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 24709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:01.876458 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:01.885759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:01.887423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:01.888630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8de20cd7-7983-4544-99cf-691b7363f096 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.242234 Apr 20 19:35:01.889308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 395/843] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:01 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:35:02.100544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:02.101347 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:02.110787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:02.111293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:02.112120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:02.112614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:02.323792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:02.333140 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-78a842aa-b49a-424d-bec1-81e0eaa82fe0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.237168 Apr 20 19:35:02.333760 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 449/844] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:35:02 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:35:02.708380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc9c6e01-5ed5-4eff-ba6a-1fafabd6c58d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:02.709533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc9c6e01-5ed5-4eff-ba6a-1fafabd6c58d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:02.717949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e01-5ed5-4eff-ba6a-1fafabd6c58d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:02.718418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e01-5ed5-4eff-ba6a-1fafabd6c58d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:02.719634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e01-5ed5-4eff-ba6a-1fafabd6c58d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:02.720198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e01-5ed5-4eff-ba6a-1fafabd6c58d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:02.755658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-85bed729-03a7-4a95-b5d6-4611ec5975ed req-fe7c0ead-4773-4f9c-ae32-431554cc835d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f0c78d-b4ea-45e9-8304-c38a70bb2490", "name": "network-vif-plugged", "status": "completed", "tag": "076208ee-e3f1-45f9-b986-47a5b26317b8"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:02.758940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:35:02.758940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:35:02.769257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-85bed729-03a7-4a95-b5d6-4611ec5975ed req-fe7c0ead-4773-4f9c-ae32-431554cc835d service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:02.770029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-85bed729-03a7-4a95-b5d6-4611ec5975ed req-fe7c0ead-4773-4f9c-ae32-431554cc835d service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:02.792557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-85bed729-03a7-4a95-b5d6-4611ec5975ed req-fe7c0ead-4773-4f9c-ae32-431554cc835d service nova] Creating event network-vif-plugged:076208ee-e3f1-45f9-b986-47a5b26317b8 for instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 on hv-cinder-78726 Apr 20 19:35:02.798634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-85bed729-03a7-4a95-b5d6-4611ec5975ed req-fe7c0ead-4773-4f9c-ae32-431554cc835d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049793 Apr 20 19:35:02.799305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 450/845] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:35:02.882253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc9c6e01-5ed5-4eff-ba6a-1fafabd6c58d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 26302 microversion: 2.1 time: 0.177950 Apr 20 19:35:02.883196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 396/846] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:02 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 26302 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:02.909829 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:02.910645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:02.918644 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:02.919156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:02.919999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:02.920497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:03.144527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:03.153981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:03.155648 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:03.157455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-da86fbc8-a257-4b59-bd57-9a96abdee878 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.252993 Apr 20 19:35:03.158071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 451/847] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:02 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:03.351634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:03.352338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:03.361153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:03.361655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:03.362486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:03.362979 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:03.580400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:03.589232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fffb9ff9-d1b4-40ad-94b7-c7bfc73ce3c3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1261 microversion: 2.1 time: 0.242275 Apr 20 19:35:03.589860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 397/848] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:35:03 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:35:03.894871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c59472dc-6ef0-4b28-bf0b-2a95ef5b648a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:03.895930 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c59472dc-6ef0-4b28-bf0b-2a95ef5b648a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:03.903844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59472dc-6ef0-4b28-bf0b-2a95ef5b648a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:03.904358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59472dc-6ef0-4b28-bf0b-2a95ef5b648a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:03.905231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59472dc-6ef0-4b28-bf0b-2a95ef5b648a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:03.905739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c59472dc-6ef0-4b28-bf0b-2a95ef5b648a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:04.056441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c59472dc-6ef0-4b28-bf0b-2a95ef5b648a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 27327 microversion: 2.1 time: 0.165978 Apr 20 19:35:04.058533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 452/849] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:03 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 27327 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:04.177722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:04.178309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:04.190574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:04.191085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:04.191937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:04.192413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:04.607344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:04.608354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:04.618157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:04.618662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:04.619509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:04.620051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:04.635009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:04.645232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:04.646925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:04.648157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-445f4a0e-3498-414a-923f-ac19ace8eb05 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.474720 Apr 20 19:35:04.648787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 398/850] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:04 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:35:04.833167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:04.842056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e2b3aa00-b393-4b8a-a01f-5126fa35c949 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1446 microversion: 2.1 time: 0.239783 Apr 20 19:35:04.842677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 453/851] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:35:04 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1446 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:35:04.860477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:04.861227 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:04.869185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:04.869694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:04.870536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:04.871032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:05.068471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7616c2b5-ba8f-42bd-8d41-0c0cf8640d24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:05.069567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7616c2b5-ba8f-42bd-8d41-0c0cf8640d24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:05.077548 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7616c2b5-ba8f-42bd-8d41-0c0cf8640d24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:05.078683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7616c2b5-ba8f-42bd-8d41-0c0cf8640d24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:05.079538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7616c2b5-ba8f-42bd-8d41-0c0cf8640d24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:05.080092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7616c2b5-ba8f-42bd-8d41-0c0cf8640d24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:05.086571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:05.095968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-24c37596-8e20-48bf-b7bd-3acbdf020d74 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1446 microversion: 2.1 time: 0.240000 Apr 20 19:35:05.096555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 399/852] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:35:04 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1446 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:35:05.216155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7616c2b5-ba8f-42bd-8d41-0c0cf8640d24 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 27855 microversion: 2.1 time: 0.151528 Apr 20 19:35:05.220359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 454/853] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:05 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 27855 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:35:05.667809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:05.668477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:05.677004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:05.677512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:05.678392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:05.678884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:05.892999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:05.902699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:05.904411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:05.905658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fdda2ef6-3603-4c09-af22-23857bb9e4f8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.241955 Apr 20 19:35:05.907071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 400/854] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:05 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:06.228832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-512a6745-09fd-432c-8ac4-7a794bb2d9c1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:06.229955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-512a6745-09fd-432c-8ac4-7a794bb2d9c1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:06.238596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-512a6745-09fd-432c-8ac4-7a794bb2d9c1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:06.239104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-512a6745-09fd-432c-8ac4-7a794bb2d9c1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:06.239938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-512a6745-09fd-432c-8ac4-7a794bb2d9c1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:06.240426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-512a6745-09fd-432c-8ac4-7a794bb2d9c1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:06.373654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-512a6745-09fd-432c-8ac4-7a794bb2d9c1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 28222 microversion: 2.1 time: 0.149233 Apr 20 19:35:06.374730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 455/855] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:06 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 28222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:06.926525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:06.927236 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:06.935628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:06.936138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:06.936996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:06.937606 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:07.156565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:07.166106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:07.167778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:07.169028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-da418254-4c62-45be-a6e6-cd0f6263ea46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.246788 Apr 20 19:35:07.169654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 401/856] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:06 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:07.386910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a41d4715-1776-43c1-b96c-fbf7c3b921b4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:07.388072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a41d4715-1776-43c1-b96c-fbf7c3b921b4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:07.398365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41d4715-1776-43c1-b96c-fbf7c3b921b4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:07.398890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41d4715-1776-43c1-b96c-fbf7c3b921b4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:07.399762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41d4715-1776-43c1-b96c-fbf7c3b921b4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:07.400263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a41d4715-1776-43c1-b96c-fbf7c3b921b4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:07.528368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a41d4715-1776-43c1-b96c-fbf7c3b921b4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 28222 microversion: 2.1 time: 0.145779 Apr 20 19:35:07.533080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 456/857] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:07 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 28222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:07.958464 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-b44b2a7d-7ada-4d42-83a5-af9fcf4ae903 req-bd607873-2820-4762-8b3a-6b42ce6b6223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f0c78d-b4ea-45e9-8304-c38a70bb2490", "tag": "076208ee-e3f1-45f9-b986-47a5b26317b8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:07.960132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:35:07.960132 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:35:07.969492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b44b2a7d-7ada-4d42-83a5-af9fcf4ae903 req-bd607873-2820-4762-8b3a-6b42ce6b6223 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:07.970002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-b44b2a7d-7ada-4d42-83a5-af9fcf4ae903 req-bd607873-2820-4762-8b3a-6b42ce6b6223 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:07.988244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-b44b2a7d-7ada-4d42-83a5-af9fcf4ae903 req-bd607873-2820-4762-8b3a-6b42ce6b6223 service nova] Creating event network-changed:076208ee-e3f1-45f9-b986-47a5b26317b8 for instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 on hv-cinder-78726 Apr 20 19:35:07.993486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-b44b2a7d-7ada-4d42-83a5-af9fcf4ae903 req-bd607873-2820-4762-8b3a-6b42ce6b6223 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038938 Apr 20 19:35:07.994405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 402/858] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:35:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:08.190034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:08.190831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:08.199666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:08.200246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:08.201128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:08.201634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:08.425328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:08.435870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:08.438561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:08.440031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-588f2956-2bda-4951-ae72-c4e882a14f6d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.254740 Apr 20 19:35:08.441286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 457/859] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:08 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:08.542934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aa549137-e42c-4efb-9ade-d2cd2fe735a3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:08.544015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aa549137-e42c-4efb-9ade-d2cd2fe735a3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:08.552779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa549137-e42c-4efb-9ade-d2cd2fe735a3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:08.553509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa549137-e42c-4efb-9ade-d2cd2fe735a3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:08.554555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa549137-e42c-4efb-9ade-d2cd2fe735a3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:08.555364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aa549137-e42c-4efb-9ade-d2cd2fe735a3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:08.693486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aa549137-e42c-4efb-9ade-d2cd2fe735a3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 28513 microversion: 2.1 time: 0.153868 Apr 20 19:35:08.695324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 403/860] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:08 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 28513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:09.461727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:09.462397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:09.470978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:09.471477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:09.472360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:09.472915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:09.703091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:09.706970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fec310e3-1a3f-4324-85d1-8190d114cd86 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:09.708101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fec310e3-1a3f-4324-85d1-8190d114cd86 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:09.713368 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:09.715320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:09.716683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a5093ecb-3b09-4f2e-be97-9f6f607bab80 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.260985 Apr 20 19:35:09.717423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 458/861] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:09 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:09.717546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec310e3-1a3f-4324-85d1-8190d114cd86 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:09.718164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec310e3-1a3f-4324-85d1-8190d114cd86 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:09.719633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec310e3-1a3f-4324-85d1-8190d114cd86 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:09.720139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fec310e3-1a3f-4324-85d1-8190d114cd86 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:09.861722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fec310e3-1a3f-4324-85d1-8190d114cd86 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 28680 microversion: 2.1 time: 0.159000 Apr 20 19:35:09.862505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 404/862] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:09 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 28680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:35:10.738121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:10.738725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:10.746573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:10.747089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:10.747928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:10.748425 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:10.875709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad9c00eb-c72f-434a-909f-0f23d2c030eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:10.876892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad9c00eb-c72f-434a-909f-0f23d2c030eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:10.885723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9c00eb-c72f-434a-909f-0f23d2c030eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:10.886246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9c00eb-c72f-434a-909f-0f23d2c030eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:10.887103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9c00eb-c72f-434a-909f-0f23d2c030eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:10.887610 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad9c00eb-c72f-434a-909f-0f23d2c030eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:10.966768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:10.976452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:10.978156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:10.979388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc04fcb0-56d0-44b0-a44a-e9a9a4e2491e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1745 microversion: 2.20 time: 0.246013 Apr 20 19:35:10.980007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 459/863] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:10 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1745 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:11.020237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad9c00eb-c72f-434a-909f-0f23d2c030eb tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 28680 microversion: 2.1 time: 0.149551 Apr 20 19:35:11.021054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 405/864] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:10 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 28680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:35:11.999173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:12.000376 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:12.009170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:12.009723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:12.010564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:12.011059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:12.033957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e596b8f5-8712-4ed5-89c1-937d18a0edf1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:12.035130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e596b8f5-8712-4ed5-89c1-937d18a0edf1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:12.045256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e596b8f5-8712-4ed5-89c1-937d18a0edf1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:12.045709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e596b8f5-8712-4ed5-89c1-937d18a0edf1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:12.046612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e596b8f5-8712-4ed5-89c1-937d18a0edf1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:12.047160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e596b8f5-8712-4ed5-89c1-937d18a0edf1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:12.183107 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e596b8f5-8712-4ed5-89c1-937d18a0edf1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 28680 microversion: 2.1 time: 0.154106 Apr 20 19:35:12.184121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 406/865] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:12 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 28680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:35:12.228607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:12.238914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:12.240614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:12.241900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2c0badd1-0e5c-4b48-abc2-5fca8e2bf866 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1745 microversion: 2.20 time: 0.246998 Apr 20 19:35:12.242514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 460/866] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:11 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:13.196750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc444836-6d53-4572-9124-87f671b1206d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:13.198179 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc444836-6d53-4572-9124-87f671b1206d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:13.208327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc444836-6d53-4572-9124-87f671b1206d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:13.209199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc444836-6d53-4572-9124-87f671b1206d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:13.210339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc444836-6d53-4572-9124-87f671b1206d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:13.211039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc444836-6d53-4572-9124-87f671b1206d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:13.262285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:13.262878 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:13.271795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:13.272279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:13.273181 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:13.273680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:13.335726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc444836-6d53-4572-9124-87f671b1206d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 28680 microversion: 2.1 time: 0.143309 Apr 20 19:35:13.336781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 407/867] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:13 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 28680 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:13.522392 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:13.535567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:13.537269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:13.538876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ce70ffd2-aa52-4609-aa33-afb61370825c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.280741 Apr 20 19:35:13.539664 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 461/868] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:13 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:35:14.349404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-28bd6a7b-7ece-48f3-941a-23d8ed96a903 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:14.351371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-28bd6a7b-7ece-48f3-941a-23d8ed96a903 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:14.361294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28bd6a7b-7ece-48f3-941a-23d8ed96a903 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:14.362166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28bd6a7b-7ece-48f3-941a-23d8ed96a903 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:14.363138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28bd6a7b-7ece-48f3-941a-23d8ed96a903 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:14.363865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-28bd6a7b-7ece-48f3-941a-23d8ed96a903 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:14.529964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-28bd6a7b-7ece-48f3-941a-23d8ed96a903 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 29880 microversion: 2.1 time: 0.184821 Apr 20 19:35:14.532029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 408/869] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:14 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 29880 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:14.560935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:14.563843 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:14.572344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:14.573080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:14.574094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:14.574769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:14.822721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:14.834144 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:14.835810 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:14.837315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-35149e77-4329-4051-a84b-505fb7e07818 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.281624 Apr 20 19:35:14.838436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 462/870] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:14 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:14.899335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-4307c249-ede7-4b2e-a8d4-e19f2ba96328 req-456340a9-6c6c-471b-8f16-cb40e9f10a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3257299-ff9d-47e8-862f-5d8becad1633", "name": "network-vif-plugged", "status": "completed", "tag": "a3a21964-a28d-45cc-b821-a61ffedb9528"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:14.901806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:35:14.901806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:35:14.916168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-4307c249-ede7-4b2e-a8d4-e19f2ba96328 req-456340a9-6c6c-471b-8f16-cb40e9f10a1b service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:14.916680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-4307c249-ede7-4b2e-a8d4-e19f2ba96328 req-456340a9-6c6c-471b-8f16-cb40e9f10a1b service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:14.941204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-4307c249-ede7-4b2e-a8d4-e19f2ba96328 req-456340a9-6c6c-471b-8f16-cb40e9f10a1b service nova] Creating event network-vif-plugged:a3a21964-a28d-45cc-b821-a61ffedb9528 for instance c3257299-ff9d-47e8-862f-5d8becad1633 on hv-cinder-78726 Apr 20 19:35:14.948556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-4307c249-ede7-4b2e-a8d4-e19f2ba96328 req-456340a9-6c6c-471b-8f16-cb40e9f10a1b service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053587 Apr 20 19:35:14.949508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 409/871] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:15.543869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44b571f3-97e5-4294-806c-6fe764c1dca3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:15.545212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44b571f3-97e5-4294-806c-6fe764c1dca3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:15.553732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b571f3-97e5-4294-806c-6fe764c1dca3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:15.554250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b571f3-97e5-4294-806c-6fe764c1dca3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:15.555391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b571f3-97e5-4294-806c-6fe764c1dca3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:15.555889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44b571f3-97e5-4294-806c-6fe764c1dca3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:15.704877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44b571f3-97e5-4294-806c-6fe764c1dca3 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 31711 microversion: 2.1 time: 0.164747 Apr 20 19:35:15.706150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 463/872] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:15 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 31711 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:15.860417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:15.861249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:15.870297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:15.870812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:15.871683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:15.872174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:16.166640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:16.177117 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:16.179190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:16.180437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-640652a2-ab79-4c94-a742-945b68b68126 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.325466 Apr 20 19:35:16.181105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 410/873] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:15 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:16.718945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-665af3f4-f928-418a-bdaf-9e1a3393ab7b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:16.720322 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-665af3f4-f928-418a-bdaf-9e1a3393ab7b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:16.729019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-665af3f4-f928-418a-bdaf-9e1a3393ab7b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:16.729635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-665af3f4-f928-418a-bdaf-9e1a3393ab7b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:16.730769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-665af3f4-f928-418a-bdaf-9e1a3393ab7b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:16.731361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-665af3f4-f928-418a-bdaf-9e1a3393ab7b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:16.879057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-665af3f4-f928-418a-bdaf-9e1a3393ab7b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 32844 microversion: 2.1 time: 0.164939 Apr 20 19:35:16.879869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 464/874] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:16 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 32844 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:17.200542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:17.201278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:17.210708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:17.211262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:17.212168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:17.212673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:17.455890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:17.466589 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:17.469463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:17.471105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e51f23da-13af-4c5a-8d04-b5cea64c00ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.274925 Apr 20 19:35:17.471976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 411/875] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:17 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:17.893854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-86bd7733-d3ae-4381-b9da-b096b8058109 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:17.895784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-86bd7733-d3ae-4381-b9da-b096b8058109 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:17.905136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86bd7733-d3ae-4381-b9da-b096b8058109 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:17.905974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86bd7733-d3ae-4381-b9da-b096b8058109 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:17.907613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86bd7733-d3ae-4381-b9da-b096b8058109 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:17.908296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86bd7733-d3ae-4381-b9da-b096b8058109 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:18.058890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-86bd7733-d3ae-4381-b9da-b096b8058109 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 33721 microversion: 2.1 time: 0.170258 Apr 20 19:35:18.063884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 465/876] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:17 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 33721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:35:18.491958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:18.492642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:18.502046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:18.502558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:18.503446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:18.503943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:18.752099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:18.763000 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:18.764688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:18.766795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-715d8e6e-dc7c-4fda-81ec-d9780e8839ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.279410 Apr 20 19:35:18.767563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 412/877] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:18 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:19.073189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ec4eb299-bd22-442c-8583-92c4441b0e3b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:19.075488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ec4eb299-bd22-442c-8583-92c4441b0e3b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:19.085792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4eb299-bd22-442c-8583-92c4441b0e3b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:19.086305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4eb299-bd22-442c-8583-92c4441b0e3b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:19.087164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4eb299-bd22-442c-8583-92c4441b0e3b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:19.087661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ec4eb299-bd22-442c-8583-92c4441b0e3b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:19.233406 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ec4eb299-bd22-442c-8583-92c4441b0e3b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 34928 microversion: 2.1 time: 0.164718 Apr 20 19:35:19.234903 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 466/878] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:19 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 34928 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:19.787232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:19.787928 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:19.796916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:19.797295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:19.798156 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:19.798628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:20.028639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:20.039788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:20.041432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:20.042683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-93cda528-30e2-4d9f-84dc-9426235cb786 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.259606 Apr 20 19:35:20.043481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 413/879] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:19 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:20.247065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-15d0ef32-f71b-47b7-b83c-babf8f16248d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:20.248240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-15d0ef32-f71b-47b7-b83c-babf8f16248d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:20.261946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d0ef32-f71b-47b7-b83c-babf8f16248d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:20.262463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d0ef32-f71b-47b7-b83c-babf8f16248d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:20.263299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d0ef32-f71b-47b7-b83c-babf8f16248d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:20.263999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-15d0ef32-f71b-47b7-b83c-babf8f16248d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:20.430449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-15d0ef32-f71b-47b7-b83c-babf8f16248d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 36174 microversion: 2.1 time: 0.187594 Apr 20 19:35:20.431276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 467/880] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:20 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 36174 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:21.066852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:21.067529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:21.076933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:21.078122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:21.079901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:21.080440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:21.323065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:21.333551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:21.335340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:21.336795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad72735c-46fc-43bc-ae2d-fce7ee9f38c2 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.276729 Apr 20 19:35:21.337415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 414/881] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:21 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:21.445591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-25d75e8f-36a5-492d-a14e-79742bbe42dc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:21.447256 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-25d75e8f-36a5-492d-a14e-79742bbe42dc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:21.473770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25d75e8f-36a5-492d-a14e-79742bbe42dc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:21.474515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25d75e8f-36a5-492d-a14e-79742bbe42dc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:21.475515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25d75e8f-36a5-492d-a14e-79742bbe42dc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:21.476145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-25d75e8f-36a5-492d-a14e-79742bbe42dc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:21.629976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-25d75e8f-36a5-492d-a14e-79742bbe42dc tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 37607 microversion: 2.1 time: 0.188719 Apr 20 19:35:21.635034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 468/882] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:21 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 37607 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:22.356645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:22.357278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:22.365691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:22.366206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:22.367045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:22.367545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:22.586134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:22.595970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:22.597685 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:22.598935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4eb76fb6-aff9-41c1-9bd5-16e0bbe6e943 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1740 microversion: 2.20 time: 0.246541 Apr 20 19:35:22.599686 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 415/883] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:22 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:22.644690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5ef3fa32-5229-4c8e-b12f-749daf24dd7d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:22.645803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5ef3fa32-5229-4c8e-b12f-749daf24dd7d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:22.654726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef3fa32-5229-4c8e-b12f-749daf24dd7d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:22.655238 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef3fa32-5229-4c8e-b12f-749daf24dd7d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:22.656680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef3fa32-5229-4c8e-b12f-749daf24dd7d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:22.657204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ef3fa32-5229-4c8e-b12f-749daf24dd7d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:22.809665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5ef3fa32-5229-4c8e-b12f-749daf24dd7d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 38205 microversion: 2.1 time: 0.170187 Apr 20 19:35:22.810491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 469/884] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:22 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 38205 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:23.618782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:23.619576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:23.628451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:23.629002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:23.629855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:23.630360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:23.823427 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7e14defb-9794-4010-a194-397c9f65ad07 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:23.824573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7e14defb-9794-4010-a194-397c9f65ad07 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:23.833614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e14defb-9794-4010-a194-397c9f65ad07 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:23.834131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e14defb-9794-4010-a194-397c9f65ad07 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:23.834991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e14defb-9794-4010-a194-397c9f65ad07 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:23.835545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7e14defb-9794-4010-a194-397c9f65ad07 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:23.860840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:23.870496 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:23.872209 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:23.873454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-452b80ad-cd76-4bdc-afe4-61394704e3b8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1722 microversion: 2.20 time: 0.258824 Apr 20 19:35:23.874091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 416/885] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:23 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:23.963031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7e14defb-9794-4010-a194-397c9f65ad07 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 38205 microversion: 2.1 time: 0.143875 Apr 20 19:35:23.963742 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 470/886] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:23 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 38205 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 19:35:24.895710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:24.896389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:24.904288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:24.904835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:24.905732 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:24.906584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:24.976751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0c83fec8-56d5-4192-b76e-747946a874b7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:24.977992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0c83fec8-56d5-4192-b76e-747946a874b7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:24.987303 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c83fec8-56d5-4192-b76e-747946a874b7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:24.987843 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c83fec8-56d5-4192-b76e-747946a874b7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:24.988885 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c83fec8-56d5-4192-b76e-747946a874b7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:24.989391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0c83fec8-56d5-4192-b76e-747946a874b7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:25.123472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0c83fec8-56d5-4192-b76e-747946a874b7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 38205 microversion: 2.1 time: 0.151214 Apr 20 19:35:25.125705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 471/887] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:24 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 38205 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:25.145444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:25.158783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:25.160454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:25.161723 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a2c470f4-5eac-42be-8189-98c503a44b01 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1722 microversion: 2.20 time: 0.270268 Apr 20 19:35:25.162334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 417/888] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:24 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:26.137320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-44abd035-e36c-41da-94a0-58ce4dff6d0d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:26.138475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-44abd035-e36c-41da-94a0-58ce4dff6d0d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:26.149634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44abd035-e36c-41da-94a0-58ce4dff6d0d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.150154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44abd035-e36c-41da-94a0-58ce4dff6d0d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.151008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44abd035-e36c-41da-94a0-58ce4dff6d0d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.151510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-44abd035-e36c-41da-94a0-58ce4dff6d0d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.181503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:26.182177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:26.190517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.191027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.191871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.192771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.285949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-44abd035-e36c-41da-94a0-58ce4dff6d0d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action" status: 200 len: 38334 microversion: 2.1 time: 0.152929 Apr 20 19:35:26.286946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 472/889] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:35:26 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/action => generated 38334 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:26.297360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ff1d6f97-6750-4db7-a41e-0bcd263232c4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:26.298064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ff1d6f97-6750-4db7-a41e-0bcd263232c4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:26.306797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff1d6f97-6750-4db7-a41e-0bcd263232c4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.307309 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff1d6f97-6750-4db7-a41e-0bcd263232c4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.308165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff1d6f97-6750-4db7-a41e-0bcd263232c4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.308663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ff1d6f97-6750-4db7-a41e-0bcd263232c4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.373780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ff1d6f97-6750-4db7-a41e-0bcd263232c4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/ips" status: 200 len: 145 microversion: 2.1 time: 0.080704 Apr 20 19:35:26.375057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 473/890] 10.222.0.38 () {58 vars in 1238 bytes} [Tue Apr 20 19:35:26 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/ips => generated 145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:35:26.412152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:26.422180 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:26.423851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:26.425178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6cb9cb51-f236-4827-a25d-9aaadc13a722 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1665 microversion: 2.20 time: 0.247800 Apr 20 19:35:26.425973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 418/891] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:26 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1665 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 19:35:26.446962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-39ec0364-7806-493d-8779-ede9ba552129 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d828050-f0e1-499f-9597-1ec2ca656bf9"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:26.448221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-39ec0364-7806-493d-8779-ede9ba552129 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:26.458993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39ec0364-7806-493d-8779-ede9ba552129 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.459236 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39ec0364-7806-493d-8779-ede9ba552129 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.460013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39ec0364-7806-493d-8779-ede9ba552129 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.460576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-39ec0364-7806-493d-8779-ede9ba552129 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.827076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-d2478a8d-64ac-4936-b410-d44e0b5bd22f req-030875c8-689c-464f-8422-309d812894e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3257299-ff9d-47e8-862f-5d8becad1633", "name": "network-vif-unplugged", "status": "completed", "tag": "a3a21964-a28d-45cc-b821-a61ffedb9528"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:26.829666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:35:26.829666 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:35:26.839093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d2478a8d-64ac-4936-b410-d44e0b5bd22f req-030875c8-689c-464f-8422-309d812894e3 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:26.839603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-d2478a8d-64ac-4936-b410-d44e0b5bd22f req-030875c8-689c-464f-8422-309d812894e3 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:26.858965 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.compute.server_external_events [req-d2478a8d-64ac-4936-b410-d44e0b5bd22f req-030875c8-689c-464f-8422-309d812894e3 service nova] Unable to find a host for instance c3257299-ff9d-47e8-862f-5d8becad1633. Dropping event network-vif-unplugged {{(pid=100563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 19:35:26.859936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-d2478a8d-64ac-4936-b410-d44e0b5bd22f req-030875c8-689c-464f-8422-309d812894e3 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037022 Apr 20 19:35:26.860582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 419/892] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:35:26 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 20 19:35:26.933278 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-39ec0364-7806-493d-8779-ede9ba552129 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.491901 Apr 20 19:35:26.933961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 474/893] 10.222.0.38 () {62 vars in 1354 bytes} [Tue Apr 20 19:35:26 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/os-volume_attachments => generated 188 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 19:35:27.046360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d34ceeea-b5a2-48ac-b5c1-fb92ef70a16e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:27.047054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d34ceeea-b5a2-48ac-b5c1-fb92ef70a16e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:27.055219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d34ceeea-b5a2-48ac-b5c1-fb92ef70a16e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.055731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d34ceeea-b5a2-48ac-b5c1-fb92ef70a16e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:27.056583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d34ceeea-b5a2-48ac-b5c1-fb92ef70a16e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.057114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d34ceeea-b5a2-48ac-b5c1-fb92ef70a16e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:27.507901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d34ceeea-b5a2-48ac-b5c1-fb92ef70a16e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/os-volume_attachments/2d828050-f0e1-499f-9597-1ec2ca656bf9" status: 202 len: 0 microversion: 2.20 time: 0.465747 Apr 20 19:35:27.508573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 420/894] 10.222.0.38 () {60 vars in 1447 bytes} [Tue Apr 20 19:35:27 2021] DELETE /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/os-volume_attachments/2d828050-f0e1-499f-9597-1ec2ca656bf9 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:35:27.612938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e02f65b3-a900-436b-a24d-8dfae9654610 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:27.613564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e02f65b3-a900-436b-a24d-8dfae9654610 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:27.622499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e02f65b3-a900-436b-a24d-8dfae9654610 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.623018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e02f65b3-a900-436b-a24d-8dfae9654610 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:27.623871 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e02f65b3-a900-436b-a24d-8dfae9654610 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.624401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e02f65b3-a900-436b-a24d-8dfae9654610 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:27.773429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e02f65b3-a900-436b-a24d-8dfae9654610 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action" status: 202 len: 0 microversion: 2.20 time: 0.165245 Apr 20 19:35:27.774096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 475/895] 10.222.0.38 () {62 vars in 1309 bytes} [Tue Apr 20 19:35:27 2021] POST /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:35:27.783661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:27.784335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:27.792183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.792688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:27.793598 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.794064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:27.917297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-26a38376-1293-47c7-8f76-b71f4b8a44da tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f778035-52a2-44e0-9792-65736a5bc02a"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:27.918597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-26a38376-1293-47c7-8f76-b71f4b8a44da tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:27.926638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26a38376-1293-47c7-8f76-b71f4b8a44da tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.927168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26a38376-1293-47c7-8f76-b71f4b8a44da tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:27.928033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26a38376-1293-47c7-8f76-b71f4b8a44da tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:27.928543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-26a38376-1293-47c7-8f76-b71f4b8a44da tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:28.030234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:28.042145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:28.044020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:28.045527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a781fd42-8b10-42b8-ba96-e342aee9862a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1673 microversion: 2.20 time: 0.266741 Apr 20 19:35:28.046630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 421/896] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:27 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1673 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:28.340431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-26a38376-1293-47c7-8f76-b71f4b8a44da tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427014 Apr 20 19:35:28.341147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 476/897] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:35:27 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:29.067362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:29.068031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:29.076283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:29.076830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:29.078674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:29.079176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:29.314120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:29.325638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:29.329481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:29.330796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-999dcbf0-cb2d-4e30-80f7-a418b40f061a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1675 microversion: 2.20 time: 0.267851 Apr 20 19:35:29.331426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 422/898] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:29 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1675 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:30.352752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:30.353433 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:30.362564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:30.363067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:30.363908 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:30.364406 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:30.586767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:30.601133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:30.602842 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:30.604069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-79412af4-6f50-41e1-a7d8-7544e419ecc6 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.256553 Apr 20 19:35:30.604668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 477/899] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:30 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:31.624918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:31.626509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:31.635082 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:31.635593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:31.636498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:31.637020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:31.876872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:31.887688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:31.889665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:31.891281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c18340df-9e5f-468f-ad82-57cabfffbd0e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.271385 Apr 20 19:35:31.891908 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 423/900] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:31 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:32.911640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:32.912416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:32.921290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:32.921894 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:32.922828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:32.923400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:33.151090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:33.161139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:33.163130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:33.164488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-20815436-60d1-485f-ac37-a459a391c3f3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.257363 Apr 20 19:35:33.165493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 478/901] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:32 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:34.185703 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:34.186299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:34.194401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:34.194907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:34.195757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:34.196207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:34.428444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:34.439451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:34.441102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:34.442360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c6310845-2e18-4d26-9aef-f797271709b4 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.260878 Apr 20 19:35:34.445348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 424/902] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:34 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:35.462857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:35.463472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:35.472022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:35.472524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:35.473382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:35.473874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:35.719126 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:35.729162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:35.730818 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:35.732056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0caf9a56-993b-4c37-adb7-fdf3788c640a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.273386 Apr 20 19:35:35.732671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 479/903] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:35 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:36.754088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:36.754874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:36.763755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:36.764363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:36.766265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:36.766769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:36.993153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:37.007037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:37.008640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:37.009917 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b98ccc06-5385-45dd-8f6d-f71d71305da3 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.261993 Apr 20 19:35:37.010524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 425/904] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:36 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:38.029709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:38.031230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:38.040476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:38.041077 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:38.041938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:38.042436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:38.266403 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:38.276614 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:38.278470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:38.279819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-67c5666e-ce5c-47e8-8a6f-25aba0d4e04c tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.254181 Apr 20 19:35:38.281451 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 480/905] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:38 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:39.300850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:39.301517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:39.309329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:39.309838 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:39.310667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:39.311155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:39.549771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:39.559403 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:39.561159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:39.563131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30a06b83-726f-4fa6-bd35-936fe75c4e11 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.266709 Apr 20 19:35:39.563941 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 426/906] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:39 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:40.585232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:40.585819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:40.595726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:40.596795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:40.597696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:40.598262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:40.824085 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:40.834653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:40.836308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:40.837580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-389ba065-812c-4f2a-9454-b711c2cf3cf8 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.257273 Apr 20 19:35:40.838419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 481/907] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:40 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:41.858086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:41.858763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:41.867384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:41.867900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:41.868756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:41.869253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:42.091112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:42.101533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:42.103207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:42.104429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-743b6bee-3d81-4cc2-a27e-6d991a05f72d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.250775 Apr 20 19:35:42.105079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 427/908] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:41 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:42.899211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dfd384ce-7fdc-49da-863d-c828774091f4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:42.900342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dfd384ce-7fdc-49da-863d-c828774091f4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:42.908633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd384ce-7fdc-49da-863d-c828774091f4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:42.909169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd384ce-7fdc-49da-863d-c828774091f4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:42.910080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd384ce-7fdc-49da-863d-c828774091f4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:42.910571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dfd384ce-7fdc-49da-863d-c828774091f4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:42.982119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dfd384ce-7fdc-49da-863d-c828774091f4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086925 Apr 20 19:35:42.982720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 482/909] 10.222.0.38 () {58 vars in 1292 bytes} [Tue Apr 20 19:35:42 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:42.993783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f888bc70-1842-4053-b0ae-71c8c017ee0b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:42.994331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f888bc70-1842-4053-b0ae-71c8c017ee0b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:43.002652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f888bc70-1842-4053-b0ae-71c8c017ee0b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:43.003161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f888bc70-1842-4053-b0ae-71c8c017ee0b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:43.003990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f888bc70-1842-4053-b0ae-71c8c017ee0b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:43.004480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f888bc70-1842-4053-b0ae-71c8c017ee0b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:43.071922 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f888bc70-1842-4053-b0ae-71c8c017ee0b tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/4f778035-52a2-44e0-9792-65736a5bc02a" status: 200 len: 194 microversion: 2.1 time: 0.082151 Apr 20 19:35:43.072477 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 428/910] 10.222.0.38 () {58 vars in 1403 bytes} [Tue Apr 20 19:35:42 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/4f778035-52a2-44e0-9792-65736a5bc02a => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:43.123603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:43.124280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:43.133844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:43.134360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:43.135216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:43.135713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:43.353949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:43.364280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:43.365972 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:43.367207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8ae793ff-5044-46f6-915a-068b43c38b46 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.247656 Apr 20 19:35:43.368149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 483/911] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:43 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:44.387763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:44.388358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:44.397071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:44.397622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:44.398473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:44.398971 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:44.585549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9b2841bb-faa4-486b-a975-56afaa6cc6fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bd7f80d-17ea-498f-9580-fcb518afe32d"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:44.586901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9b2841bb-faa4-486b-a975-56afaa6cc6fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:44.595001 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b2841bb-faa4-486b-a975-56afaa6cc6fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:44.595513 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b2841bb-faa4-486b-a975-56afaa6cc6fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:44.596363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b2841bb-faa4-486b-a975-56afaa6cc6fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:44.596924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9b2841bb-faa4-486b-a975-56afaa6cc6fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:44.612944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:44.622502 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:44.624172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:44.625999 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-202ce893-b91a-43f8-aec4-58bf7106c0ee tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.242471 Apr 20 19:35:44.626616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 429/912] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:44 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:44.990045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9b2841bb-faa4-486b-a975-56afaa6cc6fd tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408379 Apr 20 19:35:44.990901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 484/913] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:35:44 2021] POST /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:35:45.647319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:45.647996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:45.656120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:45.656634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:45.657510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:45.658006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:45.878548 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:45.887956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:45.889673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:45.891460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9f6463bd-f60f-4639-bec4-781cbfa8d01d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.248291 Apr 20 19:35:45.892080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 430/914] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:45 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:46.913317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:46.914162 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:46.923576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:46.924090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:46.925024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:46.925524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:46.983757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-39cbc8d3-89ed-4da3-a2d6-09d56b8758dd req-2a1ca5a5-d789-48bb-8fc2-c4622a308c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3257299-ff9d-47e8-862f-5d8becad1633", "name": "network-vif-plugged", "status": "completed", "tag": "a3a21964-a28d-45cc-b821-a61ffedb9528"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:35:46.985674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:35:46.985674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:35:46.994645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-39cbc8d3-89ed-4da3-a2d6-09d56b8758dd req-2a1ca5a5-d789-48bb-8fc2-c4622a308c22 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:46.995365 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-39cbc8d3-89ed-4da3-a2d6-09d56b8758dd req-2a1ca5a5-d789-48bb-8fc2-c4622a308c22 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:47.014054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-39cbc8d3-89ed-4da3-a2d6-09d56b8758dd req-2a1ca5a5-d789-48bb-8fc2-c4622a308c22 service nova] Creating event network-vif-plugged:a3a21964-a28d-45cc-b821-a61ffedb9528 for instance c3257299-ff9d-47e8-862f-5d8becad1633 on hv-cinder-78726 Apr 20 19:35:47.020004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-39cbc8d3-89ed-4da3-a2d6-09d56b8758dd req-2a1ca5a5-d789-48bb-8fc2-c4622a308c22 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040368 Apr 20 19:35:47.020659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 431/915] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:47.161554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:47.172530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:47.174220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:47.175446 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-78477c84-0fcb-4d91-8708-855589a48173 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.267365 Apr 20 19:35:47.176060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 485/916] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:46 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:48.196207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:48.197022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:48.205774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:48.206279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:48.207119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:48.207608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:48.434620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:48.444458 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:48.446249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:48.447489 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1fb1c41e-c332-4a90-b7fd-7aa77a311d5b tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1731 microversion: 2.20 time: 0.256423 Apr 20 19:35:48.448091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 432/917] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:48 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:49.468798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:49.469492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:49.478831 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:49.479352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:49.480220 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:49.480750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:49.703800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:49.713388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:49.715070 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:49.716301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ce2e95bf-f8c2-427b-a81c-7669864e8e8d tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1718 microversion: 2.20 time: 0.252430 Apr 20 19:35:49.716945 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 486/918] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:35:49 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1718 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:35:52.948233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-484a64dd-fb99-4389-8ee1-6cab939d7a2c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:52.949333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-484a64dd-fb99-4389-8ee1-6cab939d7a2c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:52.957884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484a64dd-fb99-4389-8ee1-6cab939d7a2c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:52.958401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484a64dd-fb99-4389-8ee1-6cab939d7a2c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:52.959249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484a64dd-fb99-4389-8ee1-6cab939d7a2c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:52.959754 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-484a64dd-fb99-4389-8ee1-6cab939d7a2c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:53.029212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-484a64dd-fb99-4389-8ee1-6cab939d7a2c tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.085070 Apr 20 19:35:53.029834 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 433/919] 10.222.0.38 () {58 vars in 1292 bytes} [Tue Apr 20 19:35:52 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:53.291021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ad9fe77-9b48-406f-9de2-d805802474a7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:53.291605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4ad9fe77-9b48-406f-9de2-d805802474a7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:53.299727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ad9fe77-9b48-406f-9de2-d805802474a7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:53.300233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ad9fe77-9b48-406f-9de2-d805802474a7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:53.301127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ad9fe77-9b48-406f-9de2-d805802474a7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:53.301623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4ad9fe77-9b48-406f-9de2-d805802474a7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:53.371304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ad9fe77-9b48-406f-9de2-d805802474a7 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/4f778035-52a2-44e0-9792-65736a5bc02a" status: 200 len: 194 microversion: 2.1 time: 0.084417 Apr 20 19:35:53.371946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 487/920] 10.222.0.38 () {58 vars in 1403 bytes} [Tue Apr 20 19:35:53 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/4f778035-52a2-44e0-9792-65736a5bc02a => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:53.382962 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:53.383590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:53.391454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:53.391964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:53.392824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:53.393318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:53.567984 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lazy-loading 'services' on Instance uuid 7fa4727d-dc25-4f4e-91ad-32dffa17a241 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:35:53.709067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e44e4850-5fdd-44d9-ae3b-55af2dc0d8ed tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/4f778035-52a2-44e0-9792-65736a5bc02a" status: 202 len: 0 microversion: 2.1 time: 0.329855 Apr 20 19:35:53.709709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 434/921] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:35:53 2021] DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/4f778035-52a2-44e0-9792-65736a5bc02a => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:35:56.021005 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-919e5635-b607-4ed3-ac65-4ac163d06d8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:56.021557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-919e5635-b607-4ed3-ac65-4ac163d06d8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:56.030394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-919e5635-b607-4ed3-ac65-4ac163d06d8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:56.031166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-919e5635-b607-4ed3-ac65-4ac163d06d8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:56.032092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-919e5635-b607-4ed3-ac65-4ac163d06d8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:56.032585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-919e5635-b607-4ed3-ac65-4ac163d06d8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:56.105118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-919e5635-b607-4ed3-ac65-4ac163d06d8a tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/8bd7f80d-17ea-498f-9580-fcb518afe32d" status: 200 len: 194 microversion: 2.1 time: 0.089112 Apr 20 19:35:56.105799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 488/922] 10.222.0.38 () {58 vars in 1403 bytes} [Tue Apr 20 19:35:56 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/8bd7f80d-17ea-498f-9580-fcb518afe32d => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:35:56.117386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:56.118057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:56.127128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:56.127638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:56.128486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:56.129011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:56.302105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lazy-loading 'services' on Instance uuid 7fa4727d-dc25-4f4e-91ad-32dffa17a241 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:35:56.444937 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d9e989e0-c899-4ff2-a9bf-d7a26ed52ac9 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/8bd7f80d-17ea-498f-9580-fcb518afe32d" status: 202 len: 0 microversion: 2.1 time: 0.332021 Apr 20 19:35:56.445657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 435/923] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:35:56 2021] DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241/os-volume_attachments/8bd7f80d-17ea-498f-9580-fcb518afe32d => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:35:58.037419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:58.037974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:58.045818 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:58.046323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:58.047154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:58.048152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:58.113142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:35:58.226551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-180841c1-debd-4acf-ae49-e0f96af49d60 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 204 len: 0 microversion: 2.1 time: 0.192587 Apr 20 19:35:58.227125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 489/924] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:35:58 2021] DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:35:58.237305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:58.238092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:58.246331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:58.246839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:58.247682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:58.248177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:58.465587 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:58.475262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e00579d5-00aa-4552-9ec5-1dfff8511352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1672 microversion: 2.1 time: 0.243250 Apr 20 19:35:58.475912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 436/925] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:35:58 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:35:59.495034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:35:59.495816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:35:59.504908 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:59.505417 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:59.506250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:35:59.506745 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:35:59.723277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:35:59.732237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ab06ce30-79fa-4a04-bd5e-b742a069e8b1 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1672 microversion: 2.1 time: 0.241771 Apr 20 19:35:59.732896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 490/926] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:35:59 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:36:00.752004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:00.752806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:00.760690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:00.761233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:00.762088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:00.762585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:00.980281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:00.990460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2132fdb0-9c52-4624-a5c3-c23737dcf76d tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1672 microversion: 2.1 time: 0.243032 Apr 20 19:36:00.991100 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 437/927] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:36:00 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1672 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:36:01.690927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-061d1bf2-0e95-4f11-8b2b-aa2f8db75b45 req-405d75c5-3e4a-4e02-8a61-93507ae55f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa4727d-dc25-4f4e-91ad-32dffa17a241", "name": "network-vif-deleted", "tag": "75aa08dc-b593-4a52-a8d8-8a5392fa4f68"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:36:01.692739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:36:01.692739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:36:01.701818 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-061d1bf2-0e95-4f11-8b2b-aa2f8db75b45 req-405d75c5-3e4a-4e02-8a61-93507ae55f41 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:01.702323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-061d1bf2-0e95-4f11-8b2b-aa2f8db75b45 req-405d75c5-3e4a-4e02-8a61-93507ae55f41 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:01.725486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-061d1bf2-0e95-4f11-8b2b-aa2f8db75b45 req-405d75c5-3e4a-4e02-8a61-93507ae55f41 service nova] Creating event network-vif-deleted:75aa08dc-b593-4a52-a8d8-8a5392fa4f68 for instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 on hv-cinder-78726 Apr 20 19:36:01.732101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-061d1bf2-0e95-4f11-8b2b-aa2f8db75b45 req-405d75c5-3e4a-4e02-8a61-93507ae55f41 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044928 Apr 20 19:36:01.733004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 491/928] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:36:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:36:02.010271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:02.010989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:02.020108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:02.020618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:02.021497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:02.021996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:02.100643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:02.101214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:02.101747 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lazy-loading 'fault' on Instance uuid 7fa4727d-dc25-4f4e-91ad-32dffa17a241 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:36:02.169443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '998b5783d8804bfa8d4a1c016b5666be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2fcc0eb6e6446fb2f6b877d41b57d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:02.179586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c667974-3991-4d0a-b0fc-937164a2e352 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 200 len: 1327 microversion: 2.1 time: 0.173418 Apr 20 19:36:02.180243 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 438/929] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:36:02 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 1327 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:36:03.199350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:03.200118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:03.210118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:03.210634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:03.211497 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:03.211996 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:03.266954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] HTTP exception thrown: Instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 could not be found. Apr 20 19:36:03.267635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Returning 404 to user: Instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:03.268556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-27086b31-2f37-4885-8bc9-4388ada899a4 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 404 len: 111 microversion: 2.1 time: 0.073740 Apr 20 19:36:03.269212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 492/930] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:36:03 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:03.278049 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8419b23a-e5d2-4fb4-85b5-b5e78c951c81 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '.version_select at 0x7f0387e1fc80>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:03.296537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8419b23a-e5d2-4fb4-85b5-b5e78c951c81 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805385338" status: 202 len: 0 microversion: 2.1 time: 0.022410 Apr 20 19:36:03.297199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 439/931] 10.222.0.38 () {58 vars in 1211 bytes} [Tue Apr 20 19:36:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805385338 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:36:07.045768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:07.046331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:07.055533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:07.056045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:07.056914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:07.057415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:07.111322 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] HTTP exception thrown: Instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 could not be found. Apr 20 19:36:07.112009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Returning 404 to user: Instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:07.112938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ee33d976-34da-49a2-b6e9-309bc7492097 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 404 len: 111 microversion: 2.1 time: 0.071210 Apr 20 19:36:07.113536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 493/932] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:36:07 2021] DELETE /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:07.122121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:07.122794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: 7fa4727d-dc25-4f4e-91ad-32dffa17a241] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:07.131728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:07.132235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:07.133109 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:07.133608 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:07.190183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] HTTP exception thrown: Instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 could not be found. Apr 20 19:36:07.190864 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Returning 404 to user: Instance 7fa4727d-dc25-4f4e-91ad-32dffa17a241 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:07.191762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-38f74f64-95d6-4481-9335-6a1bb17188f2 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241" status: 404 len: 111 microversion: 2.1 time: 0.073856 Apr 20 19:36:07.192356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 440/933] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:36:07 2021] GET /compute/v2.1/servers/7fa4727d-dc25-4f4e-91ad-32dffa17a241 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:08.444083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:08.444641 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:08.452740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:08.453253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:08.454142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:08.454816 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:08.507973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] HTTP exception thrown: Instance d9ed4913-e7ef-455c-9061-477f1274e3b7 could not be found. Apr 20 19:36:08.508640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Returning 404 to user: Instance d9ed4913-e7ef-455c-9061-477f1274e3b7 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:08.509566 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7c56c91f-bbf7-4959-a58a-78f9345c2f84 tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 404 len: 111 microversion: 2.1 time: 0.069629 Apr 20 19:36:08.510168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 494/934] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:36:08 2021] DELETE /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:08.519145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:08.519817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] [instance: d9ed4913-e7ef-455c-9061-477f1274e3b7] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:08.527720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:08.528217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:08.529213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:08.529718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:08.583974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] HTTP exception thrown: Instance d9ed4913-e7ef-455c-9061-477f1274e3b7 could not be found. Apr 20 19:36:08.584633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] Returning 404 to user: Instance d9ed4913-e7ef-455c-9061-477f1274e3b7 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:08.585545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2d013f06-d51c-4efc-9044-311c80d5c00e tempest-AttachVolumeTestJSON-1374272323 tempest-AttachVolumeTestJSON-1374272323-project] 10.222.0.38 "GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7" status: 404 len: 111 microversion: 2.1 time: 0.070945 Apr 20 19:36:08.586123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 441/935] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:36:08 2021] GET /compute/v2.1/servers/d9ed4913-e7ef-455c-9061-477f1274e3b7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:23.030724 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:23.031285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:23.039199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:23.039715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:23.040555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:23.041080 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:23.112663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:36:23.237870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1d32d47b-ef6c-42dd-ac86-739a42d8cb84 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 204 len: 0 microversion: 2.20 time: 0.211287 Apr 20 19:36:23.238539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 495/936] 10.222.0.38 () {60 vars in 1270 bytes} [Tue Apr 20 19:36:23 2021] DELETE /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:36:23.247178 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:23.247855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:23.257380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:23.257893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:23.258735 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:23.259237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:23.477948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:23.488414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:23.490122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:23.491343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-76cd90d5-8a58-4af4-96a9-532c62b1f1b9 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.248234 Apr 20 19:36:23.491954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 442/937] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:36:23 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:36:24.513616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:24.514395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:24.522850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:24.523363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:24.524202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:24.524699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:24.739152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:24.748537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:24.750232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:24.751952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1e0a0bc4-ce9b-41ce-8403-028cc057cf5a tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.243108 Apr 20 19:36:24.752567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 496/938] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:36:24 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:36:25.772283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:25.773007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:25.781098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:25.781616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:25.783169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:25.783661 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:26.366897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:26.377486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:26.379159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:26.381108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ba6cfa5e-3fe0-41a8-9647-038472171a4e tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1724 microversion: 2.20 time: 0.612214 Apr 20 19:36:26.381108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 443/939] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:36:25 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1724 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:36:27.400146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:27.401407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:27.411382 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:27.411900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:27.412827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:27.413338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:27.552781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:27.562644 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:27.564358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:27.565757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7dba4a4c-ce49-4f21-805b-8132bedeba2f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1657 microversion: 2.20 time: 0.169878 Apr 20 19:36:27.566352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 497/940] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:36:27 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1657 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:36:28.076630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c5d8ce48-062e-409e-83e4-f86e7e1e51a2 req-507d17f7-beee-4ef3-b6f4-eeea4cf879de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3257299-ff9d-47e8-862f-5d8becad1633", "name": "network-vif-deleted", "tag": "a3a21964-a28d-45cc-b821-a61ffedb9528"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:36:28.079311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:36:28.079311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:36:28.091034 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c5d8ce48-062e-409e-83e4-f86e7e1e51a2 req-507d17f7-beee-4ef3-b6f4-eeea4cf879de service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:28.091640 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c5d8ce48-062e-409e-83e4-f86e7e1e51a2 req-507d17f7-beee-4ef3-b6f4-eeea4cf879de service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:28.114705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c5d8ce48-062e-409e-83e4-f86e7e1e51a2 req-507d17f7-beee-4ef3-b6f4-eeea4cf879de service nova] Creating event network-vif-deleted:a3a21964-a28d-45cc-b821-a61ffedb9528 for instance c3257299-ff9d-47e8-862f-5d8becad1633 on hv-cinder-78726 Apr 20 19:36:28.120877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c5d8ce48-062e-409e-83e4-f86e7e1e51a2 req-507d17f7-beee-4ef3-b6f4-eeea4cf879de service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048085 Apr 20 19:36:28.121742 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 444/941] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:36:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:36:28.586819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:28.587651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:28.597526 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:28.598056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:28.598921 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:28.599469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:28.676166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:28.676778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:28.677276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lazy-loading 'fault' on Instance uuid c3257299-ff9d-47e8-862f-5d8becad1633 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:36:28.747389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:28.758234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:28.760459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '844312487ddb474093c475e63bb58c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7899154aeb3b4d1387b43d42a0a50996', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:36:28.762272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-58c7c6e8-b91c-43c6-8c1c-947111eb0208 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 200 len: 1372 microversion: 2.20 time: 0.180460 Apr 20 19:36:28.763223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 498/942] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:36:28 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 19:36:29.785371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:29.786154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:29.794264 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:29.794778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:29.795626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:29.796116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:29.852159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] HTTP exception thrown: Instance c3257299-ff9d-47e8-862f-5d8becad1633 could not be found. Apr 20 19:36:29.852857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Returning 404 to user: Instance c3257299-ff9d-47e8-862f-5d8becad1633 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:29.853773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4897cc5c-5a7b-4099-b2a1-b5e8ba03af52 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 404 len: 111 microversion: 2.20 time: 0.073906 Apr 20 19:36:29.854573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 445/943] 10.222.0.38 () {60 vars in 1267 bytes} [Tue Apr 20 19:36:29 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:36:29.864821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f50ad76c-2f81-45db-b9be-358a9dedaf67 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '.version_select at 0x7f0395bb4620>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:29.882901 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f50ad76c-2f81-45db-b9be-358a9dedaf67 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102400567" status: 204 len: 0 microversion: 2.20 time: 0.023558 Apr 20 19:36:29.883601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 499/944] 10.222.0.38 () {60 vars in 1252 bytes} [Tue Apr 20 19:36:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102400567 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 19:36:32.231796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:32.232409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:32.240823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:32.241327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:32.242159 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:32.242650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:32.295374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] HTTP exception thrown: Instance c3257299-ff9d-47e8-862f-5d8becad1633 could not be found. Apr 20 19:36:32.296047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Returning 404 to user: Instance c3257299-ff9d-47e8-862f-5d8becad1633 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:32.297007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-747a3681-d4e4-4f2d-ae9e-aaa229e6412f tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 404 len: 111 microversion: 2.1 time: 0.069353 Apr 20 19:36:32.298191 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 446/945] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:36:32 2021] DELETE /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:32.306822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:32.308334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: c3257299-ff9d-47e8-862f-5d8becad1633] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:32.317564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:32.318079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:32.318935 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:32.319488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:32.375173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] HTTP exception thrown: Instance c3257299-ff9d-47e8-862f-5d8becad1633 could not be found. Apr 20 19:36:32.376277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Returning 404 to user: Instance c3257299-ff9d-47e8-862f-5d8becad1633 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:32.377246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-57786cfb-bf58-4e6e-a0a8-cb87eeaae7ff tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633" status: 404 len: 111 microversion: 2.1 time: 0.074608 Apr 20 19:36:32.381211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 500/946] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:36:32 2021] GET /compute/v2.1/servers/c3257299-ff9d-47e8-862f-5d8becad1633 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:33.626950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:33.627510 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:33.635409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:33.635926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:33.636795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:33.637296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:33.693644 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] HTTP exception thrown: Instance 75ca897f-86b0-4162-a72d-2a399eef0f34 could not be found. Apr 20 19:36:33.694304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Returning 404 to user: Instance 75ca897f-86b0-4162-a72d-2a399eef0f34 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:33.695198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-36ca9aae-2bb3-4d5e-95c1-f37f6c7ae4d1 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "DELETE /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 404 len: 111 microversion: 2.1 time: 0.072862 Apr 20 19:36:33.695795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 447/947] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:36:33 2021] DELETE /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:33.705310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:33.706018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] [instance: 75ca897f-86b0-4162-a72d-2a399eef0f34] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:36:33.714335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:33.714797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:33.715634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:36:33.716125 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:36:33.770734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] HTTP exception thrown: Instance 75ca897f-86b0-4162-a72d-2a399eef0f34 could not be found. Apr 20 19:36:33.771397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] Returning 404 to user: Instance 75ca897f-86b0-4162-a72d-2a399eef0f34 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:33.772293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2c0fd032-9f98-4bc9-aaef-f1f0ff470f60 tempest-AttachVolumeShelveTestJSON-156726369 tempest-AttachVolumeShelveTestJSON-156726369-project] 10.222.0.38 "GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34" status: 404 len: 111 microversion: 2.1 time: 0.072167 Apr 20 19:36:33.773151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 501/948] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:36:33 2021] GET /compute/v2.1/servers/75ca897f-86b0-4162-a72d-2a399eef0f34 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:41.509907 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d369c39c-2335-428c-98c9-8dacc4465d49 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Action: 'create', calling method: .version_select at 0x7f0387d79e18>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-6135448", "metadata": {"Type": "work"}}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:36:41.511431 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d369c39c-2335-428c-98c9-8dacc4465d49 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:41.512295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d369c39c-2335-428c-98c9-8dacc4465d49 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131095 Apr 20 19:36:41.512954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 448/949] 10.222.0.38 () {60 vars in 1146 bytes} [Tue Apr 20 19:36:41 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:36:41.523617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-14e82f64-cf21-4a2a-8e78-3add8bbe292c tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Action: 'create', calling method: .version_select at 0x7f0394707378>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1398998616", "metadata": {"Type": "work"}}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:36:41.525219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-14e82f64-cf21-4a2a-8e78-3add8bbe292c tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:41.526090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-14e82f64-cf21-4a2a-8e78-3add8bbe292c tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006520 Apr 20 19:36:41.526658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 502/950] 10.222.0.38 () {60 vars in 1146 bytes} [Tue Apr 20 19:36:41 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:36:41.536771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ac41126-3cd8-469d-90ff-dc76c72fe69f tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Action: 'create', calling method: .version_select at 0x7f0387fa1ae8>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1238933532", "metadata": {"Type": "work"}}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:36:41.538063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4ac41126-3cd8-469d-90ff-dc76c72fe69f tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:41.539006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4ac41126-3cd8-469d-90ff-dc76c72fe69f tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006082 Apr 20 19:36:41.539558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 449/951] 10.222.0.38 () {60 vars in 1146 bytes} [Tue Apr 20 19:36:41 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 19:36:41.548893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9007188b-4e0a-4f1c-9141-257dcbca621a tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Calling method '.version_select at 0x7f03949120d0>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:41.613015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-9007188b-4e0a-4f1c-9141-257dcbca621a tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] HTTP exception thrown: Volume tempest-invalid-207213454 could not be found. Apr 20 19:36:41.613678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9007188b-4e0a-4f1c-9141-257dcbca621a tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Returning 404 to user: Volume tempest-invalid-207213454 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:41.614617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9007188b-4e0a-4f1c-9141-257dcbca621a tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/tempest-invalid-207213454" status: 404 len: 98 microversion: 2.1 time: 0.070193 Apr 20 19:36:41.615207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 503/952] 10.222.0.38 () {58 vars in 1205 bytes} [Tue Apr 20 19:36:41 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-207213454 => generated 98 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 19:36:41.625384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2a387c8c-1a19-48ea-a54c-5830a2438561 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004524 Apr 20 19:36:41.625934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 450/953] 10.222.0.38 () {58 vars in 1130 bytes} [Tue Apr 20 19:36:41 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 19:36:41.634688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8998a188-f643-4927-9f14-939a1e25d79d tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003878 Apr 20 19:36:41.635348 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 504/954] 10.222.0.38 () {58 vars in 1127 bytes} [Tue Apr 20 19:36:41 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 19:36:41.644212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-846c510d-2e9b-4811-8634-e95dc398e87f tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Calling method '.version_select at 0x7f0387d79f28>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:41.711103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-846c510d-2e9b-4811-8634-e95dc398e87f tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] HTTP exception thrown: Volume 2dc4d471-a403-433f-aefc-9a5e6c47e278 could not be found. Apr 20 19:36:41.711780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-846c510d-2e9b-4811-8634-e95dc398e87f tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Returning 404 to user: Volume 2dc4d471-a403-433f-aefc-9a5e6c47e278 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:41.712676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-846c510d-2e9b-4811-8634-e95dc398e87f tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/2dc4d471-a403-433f-aefc-9a5e6c47e278" status: 404 len: 109 microversion: 2.1 time: 0.072709 Apr 20 19:36:41.713341 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 451/955] 10.222.0.38 () {58 vars in 1238 bytes} [Tue Apr 20 19:36:41 2021] DELETE /compute/v2.1/os-volumes/2dc4d471-a403-433f-aefc-9a5e6c47e278 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:36:41.722946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-10ef8729-7542-435c-905d-accc7040cb71 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Calling method '.version_select at 0x7f0394707378>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:36:41.789773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-10ef8729-7542-435c-905d-accc7040cb71 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] HTTP exception thrown: Volume 201e9df4-22f1-4602-8dec-9b72c7503d84 could not be found. Apr 20 19:36:41.790442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-10ef8729-7542-435c-905d-accc7040cb71 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] Returning 404 to user: Volume 201e9df4-22f1-4602-8dec-9b72c7503d84 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:36:41.791384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-10ef8729-7542-435c-905d-accc7040cb71 tempest-VolumesNegativeTest-1576397223 tempest-VolumesNegativeTest-1576397223-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/201e9df4-22f1-4602-8dec-9b72c7503d84" status: 404 len: 109 microversion: 2.1 time: 0.072350 Apr 20 19:36:41.792021 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 505/956] 10.222.0.38 () {58 vars in 1235 bytes} [Tue Apr 20 19:36:41 2021] GET /compute/v2.1/os-volumes/201e9df4-22f1-4602-8dec-9b72c7503d84 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:37:06.663184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:37:06.663184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:06.670173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:06.670679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:06.671744 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:06.672287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:06.735515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lazy-loading 'flavor' on Instance uuid 57f0c78d-b4ea-45e9-8304-c38a70bb2490 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:37:06.927242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5baf4ecb-327e-479f-8186-7eea0860398c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "POST /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490/action" status: 202 len: 0 microversion: 2.1 time: 0.271042 Apr 20 19:37:06.928142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 452/957] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:37:06 2021] POST /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 19:37:06.943957 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:06.944352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:06.955196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:06.955715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:06.956582 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:06.957116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:07.184676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:07.194045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9f3ad589-f6dc-4cbe-a9be-62277a5bd4e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.260938 Apr 20 19:37:07.194676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 506/958] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:06 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:08.212943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:08.213722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:08.222399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:08.223173 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:08.224043 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:08.224546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:08.464340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:08.475539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e6d86793-49bb-4a08-9b53-ca97a5269c2a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.267312 Apr 20 19:37:08.476406 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 453/959] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:08 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:09.494179 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:09.494856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:09.503669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:09.504333 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:09.505530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:09.508919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:09.729565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:09.739009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fd3cc689-687d-4ede-8381-935c8def69e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.248778 Apr 20 19:37:09.739674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 507/960] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:09 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:10.758747 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:10.759423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:10.767857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:10.768316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:10.769189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:10.769688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:10.992827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:11.002944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-90e10b9c-b0a5-4e47-94bd-d3ec4dd86e49 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.248149 Apr 20 19:37:11.003567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 454/961] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:10 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:12.022181 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:12.022874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:12.031739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:12.032308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:12.033481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:12.034067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:12.254255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:12.263317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a0cf908b-8aca-4a72-9215-7bab815a072b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.245547 Apr 20 19:37:12.263940 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 508/962] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:12 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:13.282416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:13.283313 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:13.292084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:13.292607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:13.293498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:13.293997 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:13.525312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:13.535306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d2e35a0a-b753-46d3-a98c-3252d7ffc176 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.257330 Apr 20 19:37:13.535948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 455/963] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:13 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:14.553653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:14.554226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:14.562766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:14.563306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:14.564409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:14.564970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:14.841271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:14.850611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-678a139d-ca1d-4fbb-9a0e-04db9f6ddca2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.301074 Apr 20 19:37:14.851240 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 509/964] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:14 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:15.869078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:15.870561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:15.879104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:15.879534 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:15.880623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:15.881161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:16.116830 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:16.126658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cb9b9823-a0d6-4d81-bed0-84c4b8e7edb0 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.260926 Apr 20 19:37:16.127353 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 456/965] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:15 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:17.145968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:17.146579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:17.157400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:17.157906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:17.158875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:17.159404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:17.390560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:17.401204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-477b2f98-8f2a-436f-8c20-b0e8192890e5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.259297 Apr 20 19:37:17.402499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 510/966] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:17 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:18.425164 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:18.425766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:18.433705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:18.434217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:18.435058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:18.435553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:18.657616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:18.666694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5d1f343f-cf40-4dd9-b6e5-d4b786214539 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.246250 Apr 20 19:37:18.667323 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 457/967] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:18 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:37:19.684926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:19.685609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:19.693968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:19.694845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:19.695318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:19.695812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:19.918300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:19.927273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-354de01c-0999-449a-bc2b-d5c4c9c9a691 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.246583 Apr 20 19:37:19.927902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 511/968] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:19 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:20.945364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:20.946078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:20.954063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:20.954574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:20.955418 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:20.955899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:21.170924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:21.180295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-85079273-6409-4eed-aa5f-1d819d85b721 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.238823 Apr 20 19:37:21.181076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 458/969] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:20 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:22.120186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:37:22.120802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:37:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:37:22.199312 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:22.199929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:22.208013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:22.208533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:22.209405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:22.209911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:22.430657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:22.439991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d501c30f-6191-4373-a149-22620d712ab2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.244673 Apr 20 19:37:22.440637 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 512/970] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:22 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:23.460207 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:23.460982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:23.468859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:23.469923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:23.470793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:23.471295 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:23.695933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:23.705806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-940c399d-0e74-4237-bf91-e26498cec0af tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.249624 Apr 20 19:37:23.706475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 459/971] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:23 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:24.723902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:24.724619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:24.732454 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:24.732993 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:24.733823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:24.734315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:24.950101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:24.959087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9e877628-c0d4-453c-a287-6e770a74b2c4 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.239237 Apr 20 19:37:24.959714 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 513/972] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:24 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:25.977491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:25.978092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:25.985974 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:25.986482 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:25.987321 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:25.987815 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:26.204488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:26.213499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eafdb8ce-dd1f-4432-bf62-b650e8ccda3a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.240196 Apr 20 19:37:26.214680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 460/973] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:25 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:27.232079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:27.232680 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:27.240498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:27.241033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:27.241861 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:27.242352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:27.480757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:27.495494 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-72a24de0-d15f-4ed7-a945-15b73afc65c4 req-e64271e6-af27-4ecd-81b1-7a2c0cf55cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f0c78d-b4ea-45e9-8304-c38a70bb2490", "name": "network-vif-unplugged", "status": "completed", "tag": "076208ee-e3f1-45f9-b986-47a5b26317b8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:37:27.497562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:37:27.497562 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:37:27.504391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-07215501-a97b-40a6-b645-24671206a93c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1511 microversion: 2.1 time: 0.276301 Apr 20 19:37:27.505327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 514/974] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:27 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:27.507822 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-72a24de0-d15f-4ed7-a945-15b73afc65c4 req-e64271e6-af27-4ecd-81b1-7a2c0cf55cf8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:27.508322 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-72a24de0-d15f-4ed7-a945-15b73afc65c4 req-e64271e6-af27-4ecd-81b1-7a2c0cf55cf8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:27.522523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-303333bd-5983-41f1-81d7-dd0f80dc95a2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:37:27.523154 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-303333bd-5983-41f1-81d7-dd0f80dc95a2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:27.527423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.compute.server_external_events [req-72a24de0-d15f-4ed7-a945-15b73afc65c4 req-e64271e6-af27-4ecd-81b1-7a2c0cf55cf8 service nova] Unable to find a host for instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490. Dropping event network-vif-unplugged {{(pid=100563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 19:37:27.528372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-72a24de0-d15f-4ed7-a945-15b73afc65c4 req-e64271e6-af27-4ecd-81b1-7a2c0cf55cf8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037188 Apr 20 19:37:27.529166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 461/975] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:37:27 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 19:37:27.531438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-303333bd-5983-41f1-81d7-dd0f80dc95a2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:27.532049 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-303333bd-5983-41f1-81d7-dd0f80dc95a2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:27.533238 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-303333bd-5983-41f1-81d7-dd0f80dc95a2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:27.533737 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-303333bd-5983-41f1-81d7-dd0f80dc95a2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:27.692912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-303333bd-5983-41f1-81d7-dd0f80dc95a2 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "POST /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490/action" status: 202 len: 0 microversion: 2.1 time: 0.174129 Apr 20 19:37:27.693577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 515/976] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:37:27 2021] POST /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:37:27.702202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:27.702889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:27.711769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:27.712280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:27.713201 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:27.713789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:28.005142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:28.014296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4fe53ffd-3b13-4b1f-bcad-b4638471b325 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1519 microversion: 2.1 time: 0.316129 Apr 20 19:37:28.015128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 462/977] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:27 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1519 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:29.033738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:29.034389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:29.042642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:29.043359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:29.044045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:29.044596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:29.273647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:29.284004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a9c3be27-7d60-418f-ab20-0e38a2fe3e7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1521 microversion: 2.1 time: 0.255101 Apr 20 19:37:29.284677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 516/978] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:29 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:30.302600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:30.303339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:30.311742 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:30.312249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:30.313169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:30.313789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:30.607460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:30.619307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5397f519-19c2-4afc-aeca-e1dce82fbe7e tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1521 microversion: 2.1 time: 0.320254 Apr 20 19:37:30.620505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 463/979] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:30 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:31.640469 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:31.641663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:31.649783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:31.650327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:31.651160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:31.651646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:31.880825 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:31.889675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83131e10-018d-43f3-a016-19f2c12ab5de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.253181 Apr 20 19:37:31.890287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 517/980] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:31 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:32.909326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:32.910003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:32.917858 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:32.918367 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:32.919202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:32.919700 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:33.140570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:33.150076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4941c3d7-dff3-4dcd-a256-d44fceb4407c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.245739 Apr 20 19:37:33.150731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 464/981] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:32 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:34.170845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:34.171574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:34.180095 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:34.180612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:34.181488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:34.181990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:34.639438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:34.649036 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-38d266ac-58f0-4a41-8236-1e69876a99de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.482267 Apr 20 19:37:34.649710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 518/982] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:34 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:35.667914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:35.668543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:35.677294 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:35.677785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:35.678629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:35.679139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:35.893442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:35.902360 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-abbd6ac2-3008-4748-8981-bc0e4c55b87c tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.238574 Apr 20 19:37:35.902978 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 465/983] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:35 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:36.971123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:36.971817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:36.979743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:36.980296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:36.981171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:36.981671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:37.198741 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:37.207849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f89ab4a3-3fe3-431f-97ed-4b283ee3afe5 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.241051 Apr 20 19:37:37.208475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 519/984] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:36 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:38.225778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:38.226443 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:38.234172 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:38.234717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:38.235546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:38.236044 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:38.455959 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:38.465112 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7cd11d71-5661-4b9d-871f-ea15095bde61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.243455 Apr 20 19:37:38.465734 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 466/985] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:38 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:39.483485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:39.484155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:39.492938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:39.493448 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:39.494291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:39.494785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:39.712598 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:39.722160 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4c9ae251-c630-49d0-83c9-294ebf7edb61 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.242688 Apr 20 19:37:39.722725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 520/986] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:39 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:40.740905 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:40.741570 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:40.749260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:40.749774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:40.750607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:40.751099 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:41.044736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:41.054490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c3138695-29f1-43d6-957f-aac9c4a77994 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.318391 Apr 20 19:37:41.055123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 467/987] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:40 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:42.073688 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:42.074364 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:42.083094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:42.083628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:42.084481 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:42.085032 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:42.305609 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:42.314717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b1812bdd-5bb9-4f16-a193-a878ba4d3a6a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.245076 Apr 20 19:37:42.315357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 521/988] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:42 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:43.333395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:43.334463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:43.343304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:43.343968 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:43.345176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:43.346362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:43.600758 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:43.610190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-36ea5ab1-0e61-4f13-bdc9-de4e32aeaa9b tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.281107 Apr 20 19:37:43.611576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 468/989] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:43 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:44.634121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:44.635322 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:44.650586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:44.651558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:44.652669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:44.653102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:44.920690 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:44.930701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-967d555c-db3e-45bd-8a12-0c1a28cbc8a3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.305462 Apr 20 19:37:44.931374 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 522/990] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:44 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:45.949904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:45.950674 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:45.959652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:45.960316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:45.961357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:45.961967 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:46.213929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:46.224007 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-72562a50-7247-43fd-ae33-a6b0be42ed0d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.278127 Apr 20 19:37:46.225081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 469/991] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:45 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:47.242976 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:47.244330 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:47.254535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:47.255337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:47.257186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:47.258055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:47.744588 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:47.759223 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bb947923-9284-416d-a765-620b63b1e576 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.519515 Apr 20 19:37:47.760224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 523/992] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:47 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:48.778011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:48.779286 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:48.788770 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:48.789556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:48.790597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:48.791228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:49.360768 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:49.371051 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5e5d5096-6d9e-42cb-bdbd-8400cc8d15de tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.596983 Apr 20 19:37:49.372128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 470/993] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:48 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:50.390721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:50.391325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:50.406455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:50.408230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:50.410512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:50.411022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:50.890843 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:50.912517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4fb83d98-c6da-4232-a75b-bd508d65c48d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.526038 Apr 20 19:37:50.913122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 524/994] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:50 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:51.931710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:51.932285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:51.950749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:51.951689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:51.953028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:51.953710 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:52.156848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-f65e05d5-3c45-4bec-80aa-46c8aac22855 req-057e632a-c27f-4fdb-beb8-b89eca60fe4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f0c78d-b4ea-45e9-8304-c38a70bb2490", "name": "network-vif-plugged", "status": "completed", "tag": "076208ee-e3f1-45f9-b986-47a5b26317b8"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:37:52.160003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:37:52.160003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:37:52.187863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f65e05d5-3c45-4bec-80aa-46c8aac22855 req-057e632a-c27f-4fdb-beb8-b89eca60fe4d service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:52.188583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-f65e05d5-3c45-4bec-80aa-46c8aac22855 req-057e632a-c27f-4fdb-beb8-b89eca60fe4d service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:52.259224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-f65e05d5-3c45-4bec-80aa-46c8aac22855 req-057e632a-c27f-4fdb-beb8-b89eca60fe4d service nova] Creating event network-vif-plugged:076208ee-e3f1-45f9-b986-47a5b26317b8 for instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 on hv-cinder-78726 Apr 20 19:37:52.282553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-f65e05d5-3c45-4bec-80aa-46c8aac22855 req-057e632a-c27f-4fdb-beb8-b89eca60fe4d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130259 Apr 20 19:37:52.287827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 525/995] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:37:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:37:52.503369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:52.518522 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-65caaa8f-a8a9-4994-be5e-7bd567301dd7 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.590903 Apr 20 19:37:52.519427 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 471/996] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:51 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:53.539866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:53.541327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:53.554720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:53.555470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:53.556492 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:53.557157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:53.901933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:53.913177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-71075edf-3b60-4870-ad0a-8ef94fdce7e6 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1577 microversion: 2.1 time: 0.378577 Apr 20 19:37:53.914867 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 526/997] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:53 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1577 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:37:54.933170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:37:54.935872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:37:54.950150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:54.950934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:54.951794 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:37:54.952288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:37:55.186473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:37:55.197189 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fce7ceb5-f0b8-4cc5-b470-8a33dcca5e7d tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1564 microversion: 2.1 time: 0.268010 Apr 20 19:37:55.197813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 472/998] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:37:54 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:06.508377 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c84c4e68-c422-4fc5-af4a-015bcf171ae0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Action: 'create', calling method: .version_select at 0x7f03952398c8>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1038747756"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:06.587746 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c84c4e68-c422-4fc5-af4a-015bcf171ae0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for project 3608ab590f13437caf52ce138af80c66. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:38:06.592416 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c84c4e68-c422-4fc5-af4a-015bcf171ae0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for user a6b3e2cfd68144908bb22abb969cbd6f and project 3608ab590f13437caf52ce138af80c66. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:38:07.737342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c84c4e68-c422-4fc5-af4a-015bcf171ae0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for project 3608ab590f13437caf52ce138af80c66. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:38:07.742933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-c84c4e68-c422-4fc5-af4a-015bcf171ae0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for user a6b3e2cfd68144908bb22abb969cbd6f and project 3608ab590f13437caf52ce138af80c66. Resources: {'key_pairs'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:38:07.767452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c84c4e68-c422-4fc5-af4a-015bcf171ae0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.816262 Apr 20 19:38:07.768805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 527/999] 10.222.0.38 () {60 vars in 1148 bytes} [Tue Apr 20 19:38:05 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:16.379522 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-30d9a070-f01c-41e5-ab86-bb7f88c0d6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Action: 'create', calling method: .version_select at 0x7f0387fcf158>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1001167365"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:16.405249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-30d9a070-f01c-41e5-ab86-bb7f88c0d6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Getting quotas for project 0c4aa18a1cff47ab91e2f24617f0831d. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:38:16.410272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-30d9a070-f01c-41e5-ab86-bb7f88c0d6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Getting quotas for user 13c5c741ecc54dc08acbc5dd9169c5db and project 0c4aa18a1cff47ab91e2f24617f0831d. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:38:16.769720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-30d9a070-f01c-41e5-ab86-bb7f88c0d6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Getting quotas for project 0c4aa18a1cff47ab91e2f24617f0831d. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:38:16.773869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-30d9a070-f01c-41e5-ab86-bb7f88c0d6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Getting quotas for user 13c5c741ecc54dc08acbc5dd9169c5db and project 0c4aa18a1cff47ab91e2f24617f0831d. Resources: {'key_pairs'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:38:16.788887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-30d9a070-f01c-41e5-ab86-bb7f88c0d6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.413807 Apr 20 19:38:16.789561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 473/1000] 10.222.0.38 () {60 vars in 1148 bytes} [Tue Apr 20 19:38:16 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:16.848119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-255225620", "imageRef": "6fbbbfcc-8ed7-4e04-bfd1-419c7ab938e8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1001167365", "networks": [{"uuid": "3c1bcb0a-f075-4757-a482-b63fb34202bf"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:16.926334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] validate_networks() for [('3c1bcb0a-f075-4757-a482-b63fb34202bf', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:38:17.521805 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:38:17.522282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:38:17.522815 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:38:17.523285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:38:17.523751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:38:17.532890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:17.533405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:17.534316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:17.534809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:17.554863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Getting quotas for project 0c4aa18a1cff47ab91e2f24617f0831d. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:38:17.559190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Getting quotas for user 13c5c741ecc54dc08acbc5dd9169c5db and project 0c4aa18a1cff47ab91e2f24617f0831d. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:38:17.571287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:38:17.573902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fbbbfcc-8ed7-4e04-bfd1-419c7ab938e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:38:17.627206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1d06e88b-d8c2-4d33-b440-e6a54d71d227 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783851 Apr 20 19:38:17.627847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 528/1001] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:38:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:38:17.638515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c577ae78-1847-4e1d-ab28-da1d91ae6fce tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:17.639282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c577ae78-1847-4e1d-ab28-da1d91ae6fce tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:17.727635 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c577ae78-1847-4e1d-ab28-da1d91ae6fce tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:17.737087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c577ae78-1847-4e1d-ab28-da1d91ae6fce tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1258 microversion: 2.1 time: 0.102565 Apr 20 19:38:17.737697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 474/1002] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:17 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1258 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:18.756800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:18.757647 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:18.765939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:18.766663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:18.767662 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:18.768198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:18.898915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:18.909840 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7ea4d338-0e25-42ee-b902-8c5748302263 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1318 microversion: 2.1 time: 0.157188 Apr 20 19:38:18.910812 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 529/1003] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:18 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:19.932539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:19.934078 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:19.943743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:19.944540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:19.945618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:19.946255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:20.217619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:20.236319 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f9e2f4da-2623-44d5-9fec-32851dd92c33 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.305830 Apr 20 19:38:20.240026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 475/1004] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:19 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:21.258605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:21.259283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:21.267383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:21.267897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:21.268743 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:21.269263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:21.510927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:21.519887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f83f290d-d40e-4b9a-8f50-a0e563ea0c68 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.265512 Apr 20 19:38:21.520520 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 530/1005] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:21 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:22.539142 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:22.539793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:22.549072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:22.549578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:22.550428 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:22.550921 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:22.774788 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:22.785188 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9764b4b2-4a73-4a0f-bbd1-0617dbe99650 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.249977 Apr 20 19:38:22.785956 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 476/1006] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:22 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:23.805555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:23.806507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:23.814918 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:23.815437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:23.816518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:23.817058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:24.041780 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:24.051764 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3ff94286-6e37-4dba-aa02-c9274fc908f4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.251069 Apr 20 19:38:24.056604 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 531/1007] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:23 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:25.074373 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:25.075093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:25.083239 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:25.083749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:25.084592 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:25.085118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:25.322031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:25.331444 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-93107a37-8d77-45ad-902e-a1bb031dfbec tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.261176 Apr 20 19:38:25.332068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 477/1008] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:25 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:26.349676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:26.350350 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:26.358412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:26.358929 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:26.359790 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:26.360285 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:26.582320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:26.591282 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d848e187-6e9b-40fc-9988-d21e15c344a7 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.245934 Apr 20 19:38:26.591908 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 532/1009] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:26 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:27.610127 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:27.610952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:27.620659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:27.621192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:27.622097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:27.622591 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:27.847314 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:27.857027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c9ae8d7-3462-46b0-b135-989fa784907f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.251681 Apr 20 19:38:27.858111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 478/1010] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:27 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:28.678259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1452736173", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1038747756", "security_groups": [{"name": "tempest-secgroup-smoke-950116747"}], "block_device_mapping_v2": [{"uuid": "52f6aa42-e2a7-4898-b2ae-014e873fdce8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e361dd34-ca15-4774-93ca-f11c93f3906a"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:28.876224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:28.876888 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:28.878170 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] validate_networks() for [('e361dd34-ca15-4774-93ca-f11c93f3906a', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:38:28.884728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:28.885244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:28.886086 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:28.886578 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:29.212324 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:29.229517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ed767a80-2d57-44c3-95de-1c4c2bcad6a0 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.357766 Apr 20 19:38:29.230356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 479/1011] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:28 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:38:29.645789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:38:29.646270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:38:29.646817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:38:29.647281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:38:29.647752 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:38:29.662740 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:29.663222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:29.664120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:29.664625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:29.686250 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for project 3608ab590f13437caf52ce138af80c66. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:38:29.690566 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for user a6b3e2cfd68144908bb22abb969cbd6f and project 3608ab590f13437caf52ce138af80c66. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:38:29.803576 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:38:29.806009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52f6aa42-e2a7-4898-b2ae-014e873fdce8',volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:38:29.993684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e856a314-9352-4237-81ba-4ccd73d6a5b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.319530 Apr 20 19:38:29.994405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 533/1012] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:38:28 2021] POST /compute/v2.1/servers => generated 405 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 19:38:30.005271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b895bea7-4d8d-42d4-8d32-a59137e958e5 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:30.005953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b895bea7-4d8d-42d4-8d32-a59137e958e5 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:30.091358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b895bea7-4d8d-42d4-8d32-a59137e958e5 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:30.100653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b895bea7-4d8d-42d4-8d32-a59137e958e5 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1095 microversion: 2.1 time: 0.099373 Apr 20 19:38:30.101916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 480/1013] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:29 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:38:30.248265 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:30.248987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:30.258668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:30.259194 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:30.260061 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:30.260565 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:30.480557 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:30.490094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-88c713f9-7c22-49f2-ae87-189808f5abfc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.246373 Apr 20 19:38:30.490716 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 534/1014] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:30 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:31.119889 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:31.121296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:31.133910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:31.134426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:31.135263 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:31.135994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:31.267896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:31.276980 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-41562602-d652-42d4-a014-43e753bdad92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1193 microversion: 2.1 time: 0.161297 Apr 20 19:38:31.277621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 481/1015] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:31 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1193 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:31.507847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:31.508727 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:31.518012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:31.518669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:31.519650 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:31.520261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:31.910174 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-948bebbd-6f56-4daa-b324-7d70f66d8351 req-a53c0759-91eb-43cd-802d-2cd31c317a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c0012b-ff9d-4efb-ae80-969a50729290", "tag": "b333bc03-f3d7-4658-9517-eb5a40f2fcbf"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:31.911923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:31.911923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:31.921280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-948bebbd-6f56-4daa-b324-7d70f66d8351 req-a53c0759-91eb-43cd-802d-2cd31c317a6a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:31.923118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-948bebbd-6f56-4daa-b324-7d70f66d8351 req-a53c0759-91eb-43cd-802d-2cd31c317a6a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:31.943427 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-948bebbd-6f56-4daa-b324-7d70f66d8351 req-a53c0759-91eb-43cd-802d-2cd31c317a6a service nova] Creating event network-changed:b333bc03-f3d7-4658-9517-eb5a40f2fcbf for instance b5c0012b-ff9d-4efb-ae80-969a50729290 on hv-cinder-78726 Apr 20 19:38:31.959559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-948bebbd-6f56-4daa-b324-7d70f66d8351 req-a53c0759-91eb-43cd-802d-2cd31c317a6a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053818 Apr 20 19:38:31.960529 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 482/1016] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:38:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:38:32.025552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:32.048440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a772154b-5b57-4e91-bb28-41f077c105b4 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.532266 Apr 20 19:38:32.049763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 535/1017] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:31 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:32.298237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:32.299024 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:32.307539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:32.308055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:32.309039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:32.309537 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:32.467385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:32.482718 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0032cfd3-0f0e-43b6-b226-d27f9cffa6b0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1211 microversion: 2.1 time: 0.188886 Apr 20 19:38:32.483728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 483/1018] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:32 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:33.071939 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:33.072626 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:33.081299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:33.081817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:33.082990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:33.083504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:33.504488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:33.505224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:33.514184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:33.514624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:33.515500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:33.516047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:33.816121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:33.825425 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-daedad2f-8821-4c4e-b10b-4a4b1a778bc6 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.757657 Apr 20 19:38:33.826269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 536/1019] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:33 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:34.068491 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:34.077380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a87ccd26-6e3a-432b-9d18-6c51b3801e16 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.578355 Apr 20 19:38:34.078129 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 484/1020] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:33 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:38:34.642369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-7ee39060-bb1f-4738-a797-de58f2b85cd9 req-fa318cd8-1247-41af-9398-9bf729861e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6321bd2f-86d9-4a91-9767-a3f6ecc51353", "tag": "3c4a1857-8574-4377-b048-c866f2bad0d9"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:34.644270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:34.644270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:34.653733 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7ee39060-bb1f-4738-a797-de58f2b85cd9 req-fa318cd8-1247-41af-9398-9bf729861e8a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:34.654516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7ee39060-bb1f-4738-a797-de58f2b85cd9 req-fa318cd8-1247-41af-9398-9bf729861e8a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:34.674371 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-7ee39060-bb1f-4738-a797-de58f2b85cd9 req-fa318cd8-1247-41af-9398-9bf729861e8a service nova] Creating event network-changed:3c4a1857-8574-4377-b048-c866f2bad0d9 for instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 on hv-cinder-78726 Apr 20 19:38:34.679875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-7ee39060-bb1f-4738-a797-de58f2b85cd9 req-fa318cd8-1247-41af-9398-9bf729861e8a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109682 Apr 20 19:38:34.680800 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 537/1021] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:38:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:38:34.844553 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:34.845190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:34.853224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:34.853767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:34.854607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:34.855105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:35.097622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:35.098420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:35.106776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:35.107344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:35.108197 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:35.108699 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:35.290485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:35.299483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bdfe6cee-de4f-4870-b63e-6da3a9c25c21 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.459552 Apr 20 19:38:35.300120 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 485/1022] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:34 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:35.480526 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:35.489629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-eb8df400-9972-4170-a8ad-81f04194324f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.397201 Apr 20 19:38:35.490281 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 538/1023] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:35 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:36.317851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:36.318525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:36.326435 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:36.326947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:36.327799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:36.328297 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:36.507475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:36.508152 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:36.516783 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:36.517298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:36.518146 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:36.518683 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:36.540474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:36.550157 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4880b8c0-45e0-4a66-95a9-5c1e7f481ac5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.236429 Apr 20 19:38:36.550797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 486/1024] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:36 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:36.743262 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:36.752342 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-964ffe99-5039-4cca-be66-efc08fc2c9b4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.248873 Apr 20 19:38:36.753002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 539/1025] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:36 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:38:37.567550 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:37.568340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:37.576182 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:37.576691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:37.577572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:37.578065 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:37.769759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:37.770569 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:37.779568 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:37.780088 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:37.781115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:37.782339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:37.796006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:37.806208 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e36f333e-04a6-426c-8e0c-3a024f89b956 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.242670 Apr 20 19:38:37.807046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 487/1026] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:37 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:37.821596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-afc9d04f-91c5-41f1-b0c5-ba8181dc7814 req-9ac55388-be69-4db4-9955-540f39d8e3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c0012b-ff9d-4efb-ae80-969a50729290", "name": "network-vif-plugged", "status": "completed", "tag": "b333bc03-f3d7-4658-9517-eb5a40f2fcbf"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:37.823299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:37.823299 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:37.832493 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-afc9d04f-91c5-41f1-b0c5-ba8181dc7814 req-9ac55388-be69-4db4-9955-540f39d8e3fe service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:37.833059 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-afc9d04f-91c5-41f1-b0c5-ba8181dc7814 req-9ac55388-be69-4db4-9955-540f39d8e3fe service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:37.851495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-afc9d04f-91c5-41f1-b0c5-ba8181dc7814 req-9ac55388-be69-4db4-9955-540f39d8e3fe service nova] Creating event network-vif-plugged:b333bc03-f3d7-4658-9517-eb5a40f2fcbf for instance b5c0012b-ff9d-4efb-ae80-969a50729290 on hv-cinder-78726 Apr 20 19:38:37.856729 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-afc9d04f-91c5-41f1-b0c5-ba8181dc7814 req-9ac55388-be69-4db4-9955-540f39d8e3fe service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038849 Apr 20 19:38:37.857663 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 488/1027] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:38:38.010035 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:38.019719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5500f13b-b4cd-43a7-8bb7-95f5efca5407 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.254036 Apr 20 19:38:38.020341 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 540/1028] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:37 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:38.824539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:38.825361 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:38.833546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:38.834056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:38.834898 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:38.835395 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:39.038814 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:39.039531 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:39.048161 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:39.048677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:39.049526 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:39.050020 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:39.051897 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:39.061356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b0d7e092-eb06-4fcf-ad57-dcb572675db5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1358 microversion: 2.1 time: 0.241382 Apr 20 19:38:39.062089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 489/1029] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:38 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:39.269761 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:39.278771 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7d9fd554-fea5-41f3-a8fb-deb86ec6af31 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.244189 Apr 20 19:38:39.279669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 541/1030] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:39 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:40.080249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:40.081003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:40.089013 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.089528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.090369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.090873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.298426 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:40.299104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:40.304151 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:40.307359 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.307652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.308507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.309030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.313872 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1e5dde9a-d4bf-45a8-aca1-734fa01377fb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1547 microversion: 2.1 time: 0.238247 Apr 20 19:38:40.314613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 490/1031] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:40 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:40.330947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:40.331559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:40.339311 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.339826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.340665 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.341190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.642697 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:40.650538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:40.651762 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cc1b979b-ad8f-44e7-8e73-f79fbcb756cd tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.358126 Apr 20 19:38:40.652383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 542/1032] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:40 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:38:40.660381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4eed3d78-49ca-43a8-b2f2-4c8b99530d9d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1547 microversion: 2.1 time: 0.333412 Apr 20 19:38:40.661067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 491/1033] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:40 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1547 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:38:40.677989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:40.681682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:40.681682 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:40.682781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:40.683599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Searching by: {'deleted': False, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d'} {{(pid=100562) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 20 19:38:40.689869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.690375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.691246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.691736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.796474 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.multi_cell_list [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100562) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 20 19:38:40.901079 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ba8eb127-98a9-4145-ace8-42075346a2ed tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.226870 Apr 20 19:38:40.901873 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 543/1034] 10.222.0.38 () {58 vars in 1115 bytes} [Tue Apr 20 19:38:40 2021] GET /compute/v2.1/servers => generated 342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:38:40.914292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:40.914973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:40.922919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.923423 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:40.924305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:40.924850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:41.135452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:41.144785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b899563e-6632-4624-9933-b1a3efeacffc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1547 microversion: 2.1 time: 0.234545 Apr 20 19:38:41.145414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 492/1035] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:40 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1547 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:41.672515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:41.673300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:41.681724 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:41.682233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:41.683242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:41.683738 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:42.141564 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:42.150633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-50283619-424a-4fe9-9d80-cf66bee0c6dc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.482917 Apr 20 19:38:42.151222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 544/1036] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:41 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:42.949839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f0e48877-5110-40a2-b2a5-2c36081a952b tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da57fbcf-1cbf-45c7-8f96-1e92e5e441c9"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:42.951089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f0e48877-5110-40a2-b2a5-2c36081a952b tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:42.959597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0e48877-5110-40a2-b2a5-2c36081a952b tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:42.960108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0e48877-5110-40a2-b2a5-2c36081a952b tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:42.960988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0e48877-5110-40a2-b2a5-2c36081a952b tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:42.961488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0e48877-5110-40a2-b2a5-2c36081a952b tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:43.169599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:43.170283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:43.179476 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:43.179994 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:43.180887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:43.181377 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:43.349601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f0e48877-5110-40a2-b2a5-2c36081a952b tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403577 Apr 20 19:38:43.350296 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 493/1037] 10.222.0.38 () {60 vars in 1313 bytes} [Tue Apr 20 19:38:42 2021] POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:38:43.413138 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:43.424031 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-23312114-c5d1-456b-8c3c-7c5c2e2bb07e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.258355 Apr 20 19:38:43.424915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 545/1038] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:43 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:38:44.444961 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:44.445659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:44.454998 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:44.455511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:44.456422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:44.456955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:44.685042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:44.694558 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b48cc03d-352a-4cdf-ba24-496f3e61fd7f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.256092 Apr 20 19:38:44.695232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 494/1039] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:44 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:45.711809 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:45.712527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:45.720599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:45.721320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:45.722177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:45.722675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:45.869122 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-5a374d89-7b57-4a19-8a5b-a0c5e2d39315 req-988f6d51-2c98-423d-a17c-184824b04927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6321bd2f-86d9-4a91-9767-a3f6ecc51353", "name": "network-vif-plugged", "status": "completed", "tag": "3c4a1857-8574-4377-b048-c866f2bad0d9"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:45.871629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:45.871629 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:45.882713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-5a374d89-7b57-4a19-8a5b-a0c5e2d39315 req-988f6d51-2c98-423d-a17c-184824b04927 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:45.883590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-5a374d89-7b57-4a19-8a5b-a0c5e2d39315 req-988f6d51-2c98-423d-a17c-184824b04927 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:45.907947 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-5a374d89-7b57-4a19-8a5b-a0c5e2d39315 req-988f6d51-2c98-423d-a17c-184824b04927 service nova] Creating event network-vif-plugged:3c4a1857-8574-4377-b048-c866f2bad0d9 for instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 on hv-cinder-78726 Apr 20 19:38:45.913625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-5a374d89-7b57-4a19-8a5b-a0c5e2d39315 req-988f6d51-2c98-423d-a17c-184824b04927 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050294 Apr 20 19:38:45.914452 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 495/1040] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:38:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:38:45.950859 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:45.962044 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6c7bcd38-d8db-47ec-8a7d-7a082f4c7759 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.254337 Apr 20 19:38:45.962719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 546/1041] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:45 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:46.981081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:46.981837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:46.990633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:46.991145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:46.991995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:46.992498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:47.207067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:47.215951 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-483bffcb-09da-4582-8188-3aaf8c23b3ed tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1266 microversion: 2.1 time: 0.240069 Apr 20 19:38:47.216573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 496/1042] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:46 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:48.234824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:48.235430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:48.243427 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:48.243938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:48.244824 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:48.245326 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:48.462580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:48.471659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e05c6c6f-8de8-4573-b125-977ada6d2c40 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1453 microversion: 2.1 time: 0.240960 Apr 20 19:38:48.472327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 547/1043] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:48 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:48.489900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:48.490509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:48.498356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:48.498862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:48.499694 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:48.500498 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:48.715358 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:48.725251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cfa0f473-e884-435b-be27-6f0d4b1081c3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1453 microversion: 2.1 time: 0.239353 Apr 20 19:38:48.725874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 497/1044] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:48 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1453 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:51.291267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-58b42c4c-03d1-497a-b1cc-5ceeda776fc9 req-597eee39-3021-469f-a3f9-23098bec594d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6321bd2f-86d9-4a91-9767-a3f6ecc51353", "tag": "3c4a1857-8574-4377-b048-c866f2bad0d9"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:51.291267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:51.291267 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:51.298104 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-58b42c4c-03d1-497a-b1cc-5ceeda776fc9 req-597eee39-3021-469f-a3f9-23098bec594d service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:51.298611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-58b42c4c-03d1-497a-b1cc-5ceeda776fc9 req-597eee39-3021-469f-a3f9-23098bec594d service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:51.317028 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-58b42c4c-03d1-497a-b1cc-5ceeda776fc9 req-597eee39-3021-469f-a3f9-23098bec594d service nova] Creating event network-changed:3c4a1857-8574-4377-b048-c866f2bad0d9 for instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 on hv-cinder-78726 Apr 20 19:38:51.322385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-58b42c4c-03d1-497a-b1cc-5ceeda776fc9 req-597eee39-3021-469f-a3f9-23098bec594d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039464 Apr 20 19:38:51.323301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 548/1045] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:38:51.415837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:51.420014 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:51.430017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:51.430845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:51.431915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:51.432617 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:51.928693 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:51.939384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-60106460-db65-4b1d-8aa1-e4701b6d278a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1593 microversion: 2.1 time: 0.527702 Apr 20 19:38:51.940017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 498/1046] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:51 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1593 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:38:54.941925 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-01f88a8b-e7bf-4586-80e4-f87133b22748 req-b05f41f2-4d69-4077-a440-dd7feb908025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c0012b-ff9d-4efb-ae80-969a50729290", "tag": "b333bc03-f3d7-4658-9517-eb5a40f2fcbf"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:54.944470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:54.944470 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:54.955597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-01f88a8b-e7bf-4586-80e4-f87133b22748 req-b05f41f2-4d69-4077-a440-dd7feb908025 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:54.956317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-01f88a8b-e7bf-4586-80e4-f87133b22748 req-b05f41f2-4d69-4077-a440-dd7feb908025 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:54.974455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-01f88a8b-e7bf-4586-80e4-f87133b22748 req-b05f41f2-4d69-4077-a440-dd7feb908025 service nova] Creating event network-changed:b333bc03-f3d7-4658-9517-eb5a40f2fcbf for instance b5c0012b-ff9d-4efb-ae80-969a50729290 on hv-cinder-78726 Apr 20 19:38:54.979936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-01f88a8b-e7bf-4586-80e4-f87133b22748 req-b05f41f2-4d69-4077-a440-dd7feb908025 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043172 Apr 20 19:38:54.981023 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 549/1047] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:38:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:38:56.137004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-738316548"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:56.137540 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:56.145490 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:56.145995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:56.146832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:56.147327 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:56.360927 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.network.security_group_api [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Adding security group 92a84959-1dfd-4cce-9951-b24e62b1d024 to port b333bc03-f3d7-4658-9517-eb5a40f2fcbf Apr 20 19:38:56.903400 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f2f7469b-5bf8-4b25-a12d-eb2310307201 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/action" status: 202 len: 0 microversion: 2.1 time: 0.770521 Apr 20 19:38:56.904544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 499/1048] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:38:56 2021] POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:38:56.922982 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:38:56.923950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:38:56.933709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:56.934221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:56.935067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:56.935559 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:56.996906 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-c63a0e98-1ea4-4ff3-942d-33a12e9621c6 req-0eee1cda-6742-4a9f-ae16-7886d14ddf24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c0012b-ff9d-4efb-ae80-969a50729290", "tag": "b333bc03-f3d7-4658-9517-eb5a40f2fcbf"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:38:56.999302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:38:56.999302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:38:57.009397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c63a0e98-1ea4-4ff3-942d-33a12e9621c6 req-0eee1cda-6742-4a9f-ae16-7886d14ddf24 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:38:57.010341 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-c63a0e98-1ea4-4ff3-942d-33a12e9621c6 req-0eee1cda-6742-4a9f-ae16-7886d14ddf24 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:38:57.045448 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-c63a0e98-1ea4-4ff3-942d-33a12e9621c6 req-0eee1cda-6742-4a9f-ae16-7886d14ddf24 service nova] Creating event network-changed:b333bc03-f3d7-4658-9517-eb5a40f2fcbf for instance b5c0012b-ff9d-4efb-ae80-969a50729290 on hv-cinder-78726 Apr 20 19:38:57.054325 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-c63a0e98-1ea4-4ff3-942d-33a12e9621c6 req-0eee1cda-6742-4a9f-ae16-7886d14ddf24 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061814 Apr 20 19:38:57.058073 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 500/1049] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:38:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:38:57.392352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:38:57.405266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d4d4bc4f-400e-4842-88cf-2ce132df943d tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1758 microversion: 2.1 time: 0.495524 Apr 20 19:38:57.406702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 550/1050] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:38:56 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1758 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:13.352625 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-06abeed7-8111-43ed-a5ea-370d55e94b71 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:39:13.353826 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-06abeed7-8111-43ed-a5ea-370d55e94b71 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:13.362524 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06abeed7-8111-43ed-a5ea-370d55e94b71 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:13.363029 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06abeed7-8111-43ed-a5ea-370d55e94b71 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:13.363865 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06abeed7-8111-43ed-a5ea-370d55e94b71 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:13.364362 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06abeed7-8111-43ed-a5ea-370d55e94b71 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:13.513988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-06abeed7-8111-43ed-a5ea-370d55e94b71 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/action" status: 202 len: 0 microversion: 2.1 time: 0.166185 Apr 20 19:39:13.514706 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 501/1051] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:39:13 2021] POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:39:13.523407 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:13.524093 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:13.533275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:13.533797 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:13.534671 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:13.535271 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:14.162397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:14.172411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8283e404-4237-4729-95d6-8511fce27839 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1750 microversion: 2.1 time: 0.652755 Apr 20 19:39:14.173233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 551/1052] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:13 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1750 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:15.192168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:15.193027 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:15.201437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:15.201954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:15.202868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:15.203409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:15.485275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:15.494823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d2e45e55-382d-4de7-9124-f79d1becf2dc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.307533 Apr 20 19:39:15.495460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 502/1053] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:15 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:15.621071 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:15.621624 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:15.630567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-4e732147-5eb4-4317-8758-f391ac58f5e2 req-9d76b670-39a0-49a2-9ede-529a57dd2a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57f0c78d-b4ea-45e9-8304-c38a70bb2490", "tag": "076208ee-e3f1-45f9-b986-47a5b26317b8"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:39:15.632246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:39:15.632246 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:39:15.641571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-4e732147-5eb4-4317-8758-f391ac58f5e2 req-9d76b670-39a0-49a2-9ede-529a57dd2a1a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:15.642168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-4e732147-5eb4-4317-8758-f391ac58f5e2 req-9d76b670-39a0-49a2-9ede-529a57dd2a1a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:15.643955 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:15.644463 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:15.645344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:15.645839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:15.661339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-4e732147-5eb4-4317-8758-f391ac58f5e2 req-9d76b670-39a0-49a2-9ede-529a57dd2a1a service nova] Creating event network-changed:076208ee-e3f1-45f9-b986-47a5b26317b8 for instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 on hv-cinder-78726 Apr 20 19:39:15.666713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-4e732147-5eb4-4317-8758-f391ac58f5e2 req-9d76b670-39a0-49a2-9ede-529a57dd2a1a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040276 Apr 20 19:39:15.667544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 503/1054] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:39:15.717488 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:39:15.842401 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a5226262-0b16-4c2a-b229-727fb93cc4f3 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "DELETE /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 204 len: 0 microversion: 2.1 time: 0.224284 Apr 20 19:39:15.846954 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 552/1055] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:39:15 2021] DELETE /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:39:15.853455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:15.854630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:15.864111 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:15.864622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:15.865673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:15.865973 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:16.241241 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:16.251231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7d3ebcb0-bc34-4ef1-a202-2fe372db508a tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1570 microversion: 2.1 time: 0.402462 Apr 20 19:39:16.252084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 504/1056] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:15 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1570 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:16.515404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:16.516315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:16.524349 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:16.525012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:16.525876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:16.526486 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:16.764352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:16.775148 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e2b3de4a-dadb-4e78-9a0f-a20df3707722 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.264833 Apr 20 19:39:16.775769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 553/1057] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:16 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:17.270684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:17.271369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:17.281272 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:17.281751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:17.282600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:17.283096 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:17.504238 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:17.513219 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c9ff0e8-76ba-4ca1-9a4b-0aec767d95eb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1452 microversion: 2.1 time: 0.246708 Apr 20 19:39:17.513847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 505/1058] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:17 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1452 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 19:39:17.793628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:17.794230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:17.802667 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:17.803176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:17.804015 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:17.804512 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:18.214839 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:18.224798 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1506f0b9-194b-437c-bf97-ed817b2e8e89 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.435136 Apr 20 19:39:18.225432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 554/1059] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:17 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:18.532165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:18.533114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:18.541706 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:18.542211 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:18.543053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:18.543585 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:18.922819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-814e014b-ef4b-467f-bf8d-f022a709c281 req-5d671302-b14c-4ed0-b299-737ce96f657c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57f0c78d-b4ea-45e9-8304-c38a70bb2490", "name": "network-vif-deleted", "tag": "076208ee-e3f1-45f9-b986-47a5b26317b8"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:39:18.924596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:39:18.924596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:39:18.933561 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-814e014b-ef4b-467f-bf8d-f022a709c281 req-5d671302-b14c-4ed0-b299-737ce96f657c service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:18.934063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-814e014b-ef4b-467f-bf8d-f022a709c281 req-5d671302-b14c-4ed0-b299-737ce96f657c service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:18.951863 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-814e014b-ef4b-467f-bf8d-f022a709c281 req-5d671302-b14c-4ed0-b299-737ce96f657c service nova] Creating event network-vif-deleted:076208ee-e3f1-45f9-b986-47a5b26317b8 for instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 on hv-cinder-78726 Apr 20 19:39:18.953892 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:18.957042 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-814e014b-ef4b-467f-bf8d-f022a709c281 req-5d671302-b14c-4ed0-b299-737ce96f657c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038869 Apr 20 19:39:18.957991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 555/1060] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:39:18.969876 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a3506db9-3d40-4203-af62-11f95b9a29fb tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1452 microversion: 2.1 time: 0.442050 Apr 20 19:39:18.970515 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 506/1061] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:18 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1452 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:19.244739 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:19.245642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:19.254802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:19.255318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:19.256175 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:19.256675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:19.488092 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:19.498048 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-83360074-3cf0-4e10-aa05-b15f85b11e1e tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.258002 Apr 20 19:39:19.498676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 556/1062] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:19 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:19.988388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:19.989121 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:19.997409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:19.997886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:19.998634 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:19.999882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:20.076301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:20.076866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:20.078041 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lazy-loading 'fault' on Instance uuid 57f0c78d-b4ea-45e9-8304-c38a70bb2490 {{(pid=100563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:39:20.398525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a8daafdd5147a9a0b726981c16cabe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7e670538c341e6a378232973d1ccde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:20.407472 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-93a3aee4-14d6-4571-a9dd-feb1fbfb4488 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 200 len: 1179 microversion: 2.1 time: 0.423103 Apr 20 19:39:20.408113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 507/1063] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:19 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 1179 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:20.516247 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:20.516953 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:20.525335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:20.525903 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:20.526823 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:20.527357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:20.757848 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:20.767765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-34b41a23-4a25-4dae-adbb-1f40dadf04cc tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.256274 Apr 20 19:39:20.768380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 557/1064] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:20 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:21.426275 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:21.426952 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] [instance: 57f0c78d-b4ea-45e9-8304-c38a70bb2490] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:21.434924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:21.435437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:21.436284 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:21.437447 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:21.490575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] HTTP exception thrown: Instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 could not be found. Apr 20 19:39:21.491244 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Returning 404 to user: Instance 57f0c78d-b4ea-45e9-8304-c38a70bb2490 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:39:21.492155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5c17162d-e4d1-449d-9d27-59c0b443dcd8 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490" status: 404 len: 111 microversion: 2.1 time: 0.069943 Apr 20 19:39:21.492784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 508/1065] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:21 2021] GET /compute/v2.1/servers/57f0c78d-b4ea-45e9-8304-c38a70bb2490 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:39:21.700184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9c9d0ddf-ae32-48b8-9c0e-6ba31ba31528 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] Calling method '.version_select at 0x7f0395239158>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:21.717052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9c9d0ddf-ae32-48b8-9c0e-6ba31ba31528 tempest-TestShelveInstance-88522875 tempest-TestShelveInstance-88522875-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1537066604" status: 202 len: 0 microversion: 2.1 time: 0.020698 Apr 20 19:39:21.717782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 558/1066] 10.222.0.38 () {58 vars in 1244 bytes} [Tue Apr 20 19:39:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1537066604 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:39:21.786167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:21.786866 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:21.794599 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:21.795108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:21.796628 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:21.797149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:22.034874 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:22.044566 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-be114bcb-04d0-4af7-8c13-6e23b98fc525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.262849 Apr 20 19:39:22.045237 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 509/1067] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:21 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:23.064369 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:23.065072 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:23.072987 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:23.073506 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:23.074354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:23.074851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:23.298619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:23.308257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b773a7e8-5e2a-43ed-b059-9b5ba85c0df3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.248757 Apr 20 19:39:23.309130 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 559/1068] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:23 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:24.328183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:24.328886 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:24.336912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:24.337424 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:24.338274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:24.338773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:24.563539 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:24.575621 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b8d16766-b0dd-4eb8-aa12-59a642fa6283 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.252087 Apr 20 19:39:24.580890 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 510/1069] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:24 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:25.595163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:25.595849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:25.606546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:25.607302 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:25.609852 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:25.610551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:25.886603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:25.897293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8a0066aa-7f66-4982-b928-95391bac6c19 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1755 microversion: 2.1 time: 0.307136 Apr 20 19:39:25.898245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 560/1070] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:25 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1755 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:26.916879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:39:26.917556 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:26.926721 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:26.927226 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:26.928198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:26.928949 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:27.170304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:39:27.181881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ddf19a5c-7e0f-4904-bad5-83ea695b3525 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1758 microversion: 2.1 time: 0.268854 Apr 20 19:39:27.182612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 511/1071] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:39:26 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1758 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:39:59.044594 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-738316548"}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:39:59.045253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:39:59.048832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0dec68d-633d-42b0-8790-d3cbd79055c6] AMQP server on 10.222.0.38:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 19:39:59.054755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:59.055257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:59.056089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:59.056584 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:59.266605 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.network.security_group_api [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Removing security group 92a84959-1dfd-4cce-9951-b24e62b1d024 from port b333bc03-f3d7-4658-9517-eb5a40f2fcbf Apr 20 19:39:59.779504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-8dfc7b5e-ec97-45d9-a52b-9d707d2a0e16 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/action" status: 202 len: 0 microversion: 2.1 time: 0.738909 Apr 20 19:39:59.781943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 561/1072] 10.222.0.38 () {60 vars in 1268 bytes} [Tue Apr 20 19:39:59 2021] POST /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:39:59.818475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-a3312acc-9b8d-4d38-a1b8-64b49c83458d req-0cabcf3d-ea8b-4ff1-81aa-47adcd9cc7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c0012b-ff9d-4efb-ae80-969a50729290", "tag": "b333bc03-f3d7-4658-9517-eb5a40f2fcbf"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:39:59.823532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:39:59.823532 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:39:59.839677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a3312acc-9b8d-4d38-a1b8-64b49c83458d req-0cabcf3d-ea8b-4ff1-81aa-47adcd9cc7ea service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:39:59.840292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-a3312acc-9b8d-4d38-a1b8-64b49c83458d req-0cabcf3d-ea8b-4ff1-81aa-47adcd9cc7ea service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:39:59.864883 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-a3312acc-9b8d-4d38-a1b8-64b49c83458d req-0cabcf3d-ea8b-4ff1-81aa-47adcd9cc7ea service nova] Creating event network-changed:b333bc03-f3d7-4658-9517-eb5a40f2fcbf for instance b5c0012b-ff9d-4efb-ae80-969a50729290 on hv-cinder-78726 Apr 20 19:39:59.872632 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-a3312acc-9b8d-4d38-a1b8-64b49c83458d req-0cabcf3d-ea8b-4ff1-81aa-47adcd9cc7ea service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069059 Apr 20 19:39:59.875991 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 512/1073] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:40:02.489002 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-0a5f0220-b155-4c51-b2ea-21fe6086ca23 req-6a68dea4-76a5-494e-8b65-b0f4e43f958f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c0012b-ff9d-4efb-ae80-969a50729290", "tag": "b333bc03-f3d7-4658-9517-eb5a40f2fcbf"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:40:02.491091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:40:02.491091 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:40:02.497124 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:02.497681 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:02.503560 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0a5f0220-b155-4c51-b2ea-21fe6086ca23 req-6a68dea4-76a5-494e-8b65-b0f4e43f958f service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:02.504166 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-0a5f0220-b155-4c51-b2ea-21fe6086ca23 req-6a68dea4-76a5-494e-8b65-b0f4e43f958f service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:02.506413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:02.506990 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:02.507810 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:02.508308 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:02.525554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-0a5f0220-b155-4c51-b2ea-21fe6086ca23 req-6a68dea4-76a5-494e-8b65-b0f4e43f958f service nova] Creating event network-changed:b333bc03-f3d7-4658-9517-eb5a40f2fcbf for instance b5c0012b-ff9d-4efb-ae80-969a50729290 on hv-cinder-78726 Apr 20 19:40:02.531057 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-0a5f0220-b155-4c51-b2ea-21fe6086ca23 req-6a68dea4-76a5-494e-8b65-b0f4e43f958f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046569 Apr 20 19:40:02.531983 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 513/1074] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:40:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:40:02.565590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0dec68d-633d-42b0-8790-d3cbd79055c6] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 51792. Apr 20 19:40:02.695715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.objects.instance [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lazy-loading 'services' on Instance uuid b5c0012b-ff9d-4efb-ae80-969a50729290 {{(pid=100562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 19:40:02.857038 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c209feb9-34a2-4f26-b434-70c65b6d26f3 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments/da57fbcf-1cbf-45c7-8f96-1e92e5e441c9" status: 202 len: 0 microversion: 2.1 time: 0.375259 Apr 20 19:40:02.858337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 562/1075] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:40:02 2021] DELETE /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments/da57fbcf-1cbf-45c7-8f96-1e92e5e441c9 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:40:02.868992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e8827d9c-a3f6-4c8f-888a-ad647eed1e4f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:02.870618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e8827d9c-a3f6-4c8f-888a-ad647eed1e4f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:02.886713 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8827d9c-a3f6-4c8f-888a-ad647eed1e4f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:02.887352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8827d9c-a3f6-4c8f-888a-ad647eed1e4f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:02.888305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8827d9c-a3f6-4c8f-888a-ad647eed1e4f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:02.888924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e8827d9c-a3f6-4c8f-888a-ad647eed1e4f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:02.972473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e8827d9c-a3f6-4c8f-888a-ad647eed1e4f tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108754 Apr 20 19:40:02.973411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 514/1076] 10.222.0.38 () {58 vars in 1292 bytes} [Tue Apr 20 19:40:02 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:40:03.986725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ce686432-959e-4b45-9f09-c9a4afbd932c tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:03.988012 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ce686432-959e-4b45-9f09-c9a4afbd932c tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:03.996684 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce686432-959e-4b45-9f09-c9a4afbd932c tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:03.997251 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce686432-959e-4b45-9f09-c9a4afbd932c tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:03.998097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce686432-959e-4b45-9f09-c9a4afbd932c tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:03.998592 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ce686432-959e-4b45-9f09-c9a4afbd932c tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:04.072574 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ce686432-959e-4b45-9f09-c9a4afbd932c tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090425 Apr 20 19:40:04.073372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 563/1077] 10.222.0.38 () {58 vars in 1292 bytes} [Tue Apr 20 19:40:03 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 19:40:04.084017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:04.085357 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:04.093259 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:04.093765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:04.094600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:04.095094 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:04.268183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] HTTP exception thrown: Instance b5c0012b-ff9d-4efb-ae80-969a50729290 is not attached to volume da57fbcf-1cbf-45c7-8f96-1e92e5e441c9 Apr 20 19:40:04.268891 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Returning 404 to user: Instance b5c0012b-ff9d-4efb-ae80-969a50729290 is not attached to volume da57fbcf-1cbf-45c7-8f96-1e92e5e441c9 {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:40:04.269808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2fd49417-9698-4a4f-804c-e5da91fa79f5 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments/da57fbcf-1cbf-45c7-8f96-1e92e5e441c9" status: 404 len: 154 microversion: 2.1 time: 0.190175 Apr 20 19:40:04.270413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 515/1078] 10.222.0.38 () {58 vars in 1406 bytes} [Tue Apr 20 19:40:04 2021] DELETE /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290/os-volume_attachments/da57fbcf-1cbf-45c7-8f96-1e92e5e441c9 => generated 154 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:40:05.526218 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:05.526781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:05.534896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:05.535411 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:05.536257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:05.536808 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:05.602616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Going to try to terminate instance {{(pid=100562) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:40:05.719544 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-281803e8-4490-44c3-9c46-6fc7569fd343 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 204 len: 0 microversion: 2.1 time: 0.197392 Apr 20 19:40:05.720083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 564/1079] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:40:05 2021] DELETE /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:40:05.729658 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:05.730495 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:05.738841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:05.739346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:05.740235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:05.740749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:06.141756 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:06.151415 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-7f3bd0c2-fc09-47e2-b568-870b422f8ffb tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1553 microversion: 2.1 time: 0.426743 Apr 20 19:40:06.152033 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 516/1080] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:05 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1553 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:07.171363 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:07.172141 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:07.180064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:07.180571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:07.181429 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:07.181923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:07.399307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:07.409467 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f0bb6cc2-db02-450f-b581-5ef3267d0961 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1553 microversion: 2.1 time: 0.242604 Apr 20 19:40:07.410106 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 565/1081] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:07 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:08.427769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:08.429185 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:08.437232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:08.437749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:08.438596 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:08.439098 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:08.831298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c5c741ecc54dc08acbc5dd9169c5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4aa18a1cff47ab91e2f24617f0831d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:08.840293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cb22a4c7-50ea-4053-a555-26ce8724719a tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 200 len: 1553 microversion: 2.1 time: 0.416593 Apr 20 19:40:08.840963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 517/1082] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:08 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 1553 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:08.889631 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-e6245a4a-47e7-44e0-a4d3-e9069a401a3c req-4470bd27-3fc6-4242-88b2-48408dcc3d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c0012b-ff9d-4efb-ae80-969a50729290", "name": "network-vif-deleted", "tag": "b333bc03-f3d7-4658-9517-eb5a40f2fcbf"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:40:08.891612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:40:08.891612 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:40:08.901393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e6245a4a-47e7-44e0-a4d3-e9069a401a3c req-4470bd27-3fc6-4242-88b2-48408dcc3d60 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:08.901893 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e6245a4a-47e7-44e0-a4d3-e9069a401a3c req-4470bd27-3fc6-4242-88b2-48408dcc3d60 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:08.924887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-e6245a4a-47e7-44e0-a4d3-e9069a401a3c req-4470bd27-3fc6-4242-88b2-48408dcc3d60 service nova] Creating event network-vif-deleted:b333bc03-f3d7-4658-9517-eb5a40f2fcbf for instance b5c0012b-ff9d-4efb-ae80-969a50729290 on hv-cinder-78726 Apr 20 19:40:08.932113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-e6245a4a-47e7-44e0-a4d3-e9069a401a3c req-4470bd27-3fc6-4242-88b2-48408dcc3d60 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046078 Apr 20 19:40:08.932792 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 566/1083] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:40:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:40:09.859611 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:09.860320 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] [instance: b5c0012b-ff9d-4efb-ae80-969a50729290] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:09.868432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:09.868989 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:09.869844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:09.870354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:09.924643 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] HTTP exception thrown: Instance b5c0012b-ff9d-4efb-ae80-969a50729290 could not be found. Apr 20 19:40:09.925345 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Returning 404 to user: Instance b5c0012b-ff9d-4efb-ae80-969a50729290 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:40:09.926260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3128b0b9-39d7-49c2-9564-f685d8ef3d86 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290" status: 404 len: 111 microversion: 2.1 time: 0.071435 Apr 20 19:40:09.926868 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 518/1084] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:09 2021] GET /compute/v2.1/servers/b5c0012b-ff9d-4efb-ae80-969a50729290 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:40:09.937037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a21d9f19-765b-477b-a508-97a54a18a012 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] Calling method '.version_select at 0x7f0394707378>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:09.954084 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a21d9f19-765b-477b-a508-97a54a18a012 tempest-TestMinimumBasicScenario-729835823 tempest-TestMinimumBasicScenario-729835823-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1001167365" status: 202 len: 0 microversion: 2.1 time: 0.021546 Apr 20 19:40:09.954655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 567/1085] 10.222.0.38 () {58 vars in 1262 bytes} [Tue Apr 20 19:40:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1001167365 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:40:42.138040 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:40:42.138653 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:40:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:40:46.961068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:46.961607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:46.969736 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:46.970191 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:46.971017 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:46.971508 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:47.035847 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:40:47.153026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b009a560-2bbd-444b-8637-7c1424d1a699 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "DELETE /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 204 len: 0 microversion: 2.1 time: 0.195539 Apr 20 19:40:47.153673 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 519/1086] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:40:46 2021] DELETE /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:40:47.163448 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:47.164306 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:47.172430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:47.172981 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:47.173817 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:47.174316 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:47.390967 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:47.400652 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6f6eb05b-71bb-478f-b1ec-b20808b83e92 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1578 microversion: 2.1 time: 0.242441 Apr 20 19:40:47.401310 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 568/1087] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:47 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:48.420202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:48.421067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:48.429103 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:48.429600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:48.430448 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:48.430948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:48.645795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:48.655046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3e2c09ce-5092-442f-a46a-6670f4d3ce23 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1578 microversion: 2.1 time: 0.239554 Apr 20 19:40:48.655675 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 520/1088] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:48 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1578 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:49.674233 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:49.674946 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:49.683730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:49.684298 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:49.685205 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:49.685712 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:50.093372 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:50.102784 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3cbf0a0c-dea0-424d-a4d0-122e580edbfc tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1578 microversion: 2.1 time: 0.432629 Apr 20 19:40:50.103422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 569/1089] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:49 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1578 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:50.749613 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-7ec6184f-b9ae-4de1-96dc-321099a4f18f req-81fe562b-ca6b-46d8-8514-6a2f9ddb17f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6321bd2f-86d9-4a91-9767-a3f6ecc51353", "name": "network-vif-deleted", "tag": "3c4a1857-8574-4377-b048-c866f2bad0d9"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:40:50.751936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:40:50.751936 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:40:50.762691 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7ec6184f-b9ae-4de1-96dc-321099a4f18f req-81fe562b-ca6b-46d8-8514-6a2f9ddb17f4 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:50.763192 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-7ec6184f-b9ae-4de1-96dc-321099a4f18f req-81fe562b-ca6b-46d8-8514-6a2f9ddb17f4 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:50.783147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-7ec6184f-b9ae-4de1-96dc-321099a4f18f req-81fe562b-ca6b-46d8-8514-6a2f9ddb17f4 service nova] Creating event network-vif-deleted:3c4a1857-8574-4377-b048-c866f2bad0d9 for instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 on hv-cinder-78726 Apr 20 19:40:50.789116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-7ec6184f-b9ae-4de1-96dc-321099a4f18f req-81fe562b-ca6b-46d8-8514-6a2f9ddb17f4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043664 Apr 20 19:40:50.790167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 521/1090] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:40:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:40:51.121916 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:51.122509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:51.125880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:40:51.126039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:40:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:40:51.130351 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:51.130862 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:51.131701 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:51.132196 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:51.284750 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:51.295168 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-94202596-0153-48b6-80e7-b181d4a49279 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 200 len: 1226 microversion: 2.1 time: 0.176757 Apr 20 19:40:51.304785 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 570/1091] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:51 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 1226 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:52.315037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:52.315818 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:52.324607 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:52.325149 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:52.325986 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:52.326473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:52.378869 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] HTTP exception thrown: Instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 could not be found. Apr 20 19:40:52.379533 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Returning 404 to user: Instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:40:52.381069 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ae9eb306-bac5-4275-bb66-434b3ae44905 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 404 len: 111 microversion: 2.1 time: 0.070022 Apr 20 19:40:52.381677 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 522/1092] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:52 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:40:52.497857 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-852046158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1038747756", "security_groups": [{"name": "tempest-secgroup-smoke-950116747"}], "block_device_mapping_v2": [{"uuid": "52f6aa42-e2a7-4898-b2ae-014e873fdce8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e361dd34-ca15-4774-93ca-f11c93f3906a"}]}} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:40:52.675081 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] validate_networks() for [('e361dd34-ca15-4774-93ca-f11c93f3906a', None, None, None)] {{(pid=100562) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:40:53.365590 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Flavor limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:40:53.366074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Image limits 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:40:53.366623 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Flavor pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:40:53.367089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Image pref 0:0:0 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:40:53.367555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:40:53.377224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:53.377753 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:53.378645 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:53.379136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:53.397705 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for project 3608ab590f13437caf52ce138af80c66. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:40:53.402003 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for user a6b3e2cfd68144908bb22abb969cbd6f and project 3608ab590f13437caf52ce138af80c66. Resources: {'cores', 'instances', 'ram'} {{(pid=100562) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:40:53.509819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Going to run 1 instances... {{(pid=100562) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:40:53.512231 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52f6aa42-e2a7-4898-b2ae-014e873fdce8',volume_size=None,volume_type=None)] {{(pid=100562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:40:53.687832 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-04c276b6-e11a-448b-9b95-4001f3afd0c0 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.194158 Apr 20 19:40:53.688538 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 571/1093] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:40:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:40:53.699660 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e8d734f3-8a5a-476d-b627-6a73340b95b3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:53.700335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e8d734f3-8a5a-476d-b627-6a73340b95b3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:53.784554 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e8d734f3-8a5a-476d-b627-6a73340b95b3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:53.794011 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e8d734f3-8a5a-476d-b627-6a73340b95b3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1094 microversion: 2.1 time: 0.098246 Apr 20 19:40:53.794668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 523/1094] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:53 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:54.812551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:54.813258 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:54.821934 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:54.822765 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:54.823851 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:54.824352 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:54.964755 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:54.974571 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ddc563e6-28c3-42de-a069-bda6065f9349 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1192 microversion: 2.1 time: 0.165418 Apr 20 19:40:54.975346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 572/1095] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:54 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1192 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:55.993520 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:55.994222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:56.007283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:56.007806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:56.008678 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:56.009245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:56.629287 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:56.638913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-f2dafbc3-e2b6-4f3d-9017-91597a9107a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1277 microversion: 2.1 time: 0.650149 Apr 20 19:40:56.639542 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 524/1096] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:55 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1277 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:57.482749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-e5b7bd98-8dcd-493b-8730-067bdec848dc req-9ba1e180-cd95-4e1c-bdd2-9d97bf6bbfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cea3375-150c-4b7e-a676-f1ea51ea5907", "tag": "36368e85-b55d-4ef4-b77c-7cb79d3e9efd"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:40:57.485317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:40:57.485317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:40:57.495870 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e5b7bd98-8dcd-493b-8730-067bdec848dc req-9ba1e180-cd95-4e1c-bdd2-9d97bf6bbfc8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:57.496381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e5b7bd98-8dcd-493b-8730-067bdec848dc req-9ba1e180-cd95-4e1c-bdd2-9d97bf6bbfc8 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:57.520068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-e5b7bd98-8dcd-493b-8730-067bdec848dc req-9ba1e180-cd95-4e1c-bdd2-9d97bf6bbfc8 service nova] Creating event network-changed:36368e85-b55d-4ef4-b77c-7cb79d3e9efd for instance 4cea3375-150c-4b7e-a676-f1ea51ea5907 on hv-cinder-78726 Apr 20 19:40:57.527115 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-e5b7bd98-8dcd-493b-8730-067bdec848dc req-9ba1e180-cd95-4e1c-bdd2-9d97bf6bbfc8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049677 Apr 20 19:40:57.528037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 573/1097] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:40:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:40:57.658455 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:57.659288 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:57.668393 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:57.669044 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:57.669938 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:57.670459 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:58.052180 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:58.061419 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-45b54a41-91f0-4c82-9523-2ff7ffb6beea tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.407224 Apr 20 19:40:58.062054 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 525/1098] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:57 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:40:59.080136 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:40:59.080966 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:40:59.090030 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:59.090549 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:59.091409 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:40:59.091915 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:40:59.314543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:40:59.324782 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-1a3b7632-ac68-4f02-ae21-529827271495 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.249211 Apr 20 19:40:59.325420 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 574/1099] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:40:59 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:00.343580 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:00.344307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:00.353052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:00.353567 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:00.354414 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:00.354911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:00.566834 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:00.576636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-ad6fcd3e-33a0-44d5-88b0-2f50dedac518 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.237195 Apr 20 19:41:00.577385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 526/1100] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:00 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:01.595134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:01.595811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:01.603702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:01.604217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:01.605097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:01.605600 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:01.822821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:01.831704 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e783ab2b-e0a2-457f-81b7-671e53a70c07 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.240702 Apr 20 19:41:01.832328 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 575/1101] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:01 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:02.849709 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:02.850398 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:02.858988 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:02.859503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:02.860344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:02.860875 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:03.081167 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:03.090944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-346a99ec-ff67-4235-a873-12374b0f94a1 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.245292 Apr 20 19:41:03.091577 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 527/1102] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:02 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:04.109228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:04.109910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:04.117919 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:04.118437 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:04.119280 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:04.119789 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:04.332948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:04.342920 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-a972fa96-52d9-4bc9-9ea0-a6012c33296c tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.238025 Apr 20 19:41:04.343543 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 576/1103] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:04 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:05.361630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:05.362307 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:05.371037 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:05.371551 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:05.372399 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:05.372932 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:05.586646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:05.595950 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fffc9049-c4ca-420a-8b5b-9e414fb33145 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.238384 Apr 20 19:41:05.596573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 528/1104] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:05 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:06.615232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:06.615884 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:06.624856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:06.625366 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:06.626206 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:06.626696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:06.840475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:06.849541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-86ed87d0-9196-4e83-9a4a-a3b341ede8e9 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.238335 Apr 20 19:41:06.850380 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 577/1105] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:06 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:07.868483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:07.869190 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:07.877133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:07.877651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:07.878819 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:07.879503 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:08.092317 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:08.101139 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-06470ea6-b18a-44dd-8eb6-d07cce82d945 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.237480 Apr 20 19:41:08.102279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 529/1106] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:07 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:08.886813 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6a264951-33dd-4516-97c4-a49709a4bc44 req-533cdc2a-ae91-4af8-87b9-dfd41992d919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cea3375-150c-4b7e-a676-f1ea51ea5907", "name": "network-vif-plugged", "status": "completed", "tag": "36368e85-b55d-4ef4-b77c-7cb79d3e9efd"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:41:08.888516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:41:08.888516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:41:08.899058 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6a264951-33dd-4516-97c4-a49709a4bc44 req-533cdc2a-ae91-4af8-87b9-dfd41992d919 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:08.899572 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6a264951-33dd-4516-97c4-a49709a4bc44 req-533cdc2a-ae91-4af8-87b9-dfd41992d919 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:08.922541 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6a264951-33dd-4516-97c4-a49709a4bc44 req-533cdc2a-ae91-4af8-87b9-dfd41992d919 service nova] Creating event network-vif-plugged:36368e85-b55d-4ef4-b77c-7cb79d3e9efd for instance 4cea3375-150c-4b7e-a676-f1ea51ea5907 on hv-cinder-78726 Apr 20 19:41:08.927899 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6a264951-33dd-4516-97c4-a49709a4bc44 req-533cdc2a-ae91-4af8-87b9-dfd41992d919 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223277 Apr 20 19:41:08.928806 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 578/1107] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:41:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 19:41:09.120651 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:09.121370 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:09.129552 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:09.130064 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:09.130896 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:09.131385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:09.422441 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:09.431379 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b85fbc4e-105c-4fa1-867e-89480d4def8b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1265 microversion: 2.1 time: 0.315640 Apr 20 19:41:09.432010 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 530/1108] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:09 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:10.450230 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:10.451778 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:10.460270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:10.461009 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:10.462074 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:10.462642 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:10.679150 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:10.688501 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-c8d66ae4-6f48-439d-af64-2a04c25a7364 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1451 microversion: 2.1 time: 0.242914 Apr 20 19:41:10.689153 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 579/1109] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:10 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1451 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:10.705726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:41:10.706335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:41:10.714841 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:10.715343 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:10.716177 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:10.716669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:10.933948 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:41:10.943253 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-096975f4-fc84-48e4-9f58-1f96d30b1366 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1451 microversion: 2.1 time: 0.241552 Apr 20 19:41:10.943900 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 531/1110] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:41:10 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1451 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:41:13.606833 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-e9174809-a50e-4763-9a2b-e531d5b4ae01 req-ab446d19-2c47-424b-9f39-30d7cfd5693a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cea3375-150c-4b7e-a676-f1ea51ea5907", "tag": "36368e85-b55d-4ef4-b77c-7cb79d3e9efd"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:41:13.608528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:41:13.608528 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:41:13.618101 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e9174809-a50e-4763-9a2b-e531d5b4ae01 req-ab446d19-2c47-424b-9f39-30d7cfd5693a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:41:13.618603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-e9174809-a50e-4763-9a2b-e531d5b4ae01 req-ab446d19-2c47-424b-9f39-30d7cfd5693a service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:41:13.635882 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-e9174809-a50e-4763-9a2b-e531d5b4ae01 req-ab446d19-2c47-424b-9f39-30d7cfd5693a service nova] Creating event network-changed:36368e85-b55d-4ef4-b77c-7cb79d3e9efd for instance 4cea3375-150c-4b7e-a676-f1ea51ea5907 on hv-cinder-78726 Apr 20 19:41:13.641232 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-e9174809-a50e-4763-9a2b-e531d5b4ae01 req-ab446d19-2c47-424b-9f39-30d7cfd5693a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038304 Apr 20 19:41:13.642097 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 580/1111] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:41:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:42:49.930008 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1942735266", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1038747756", "security_groups": [{"name": "tempest-secgroup-smoke-950116747"}], "block_device_mapping_v2": [{"uuid": "021ee3ab-e611-4bbb-a53b-7c76899a9a47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e361dd34-ca15-4774-93ca-f11c93f3906a"}]}} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:42:49.944763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bec1f942-4250-40c2-a7fd-008c70beac0d] AMQP server on 10.222.0.38:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 19:42:50.106679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.network.neutron [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] validate_networks() for [('e361dd34-ca15-4774-93ca-f11c93f3906a', None, None, None)] {{(pid=100563) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 19:42:50.780334 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Flavor limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 19:42:50.780880 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Image limits 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 19:42:50.781438 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Flavor pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 19:42:50.781909 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Image pref 0:0:0 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 19:42:50.782385 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.virt.hardware [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 19:42:50.791279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:50.791795 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:50.792796 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:50.793304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:50.812186 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for project 3608ab590f13437caf52ce138af80c66. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 19:42:50.816504 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.quota [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Getting quotas for user a6b3e2cfd68144908bb22abb969cbd6f and project 3608ab590f13437caf52ce138af80c66. Resources: {'cores', 'instances', 'ram'} {{(pid=100563) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 19:42:50.923787 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Going to run 1 instances... {{(pid=100563) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 19:42:50.926270 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='021ee3ab-e611-4bbb-a53b-7c76899a9a47',volume_size=None,volume_type=None)] {{(pid=100563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 19:42:50.961730 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] [bec1f942-4250-40c2-a7fd-008c70beac0d] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 52082. Apr 20 19:42:51.110394 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4d878106-ad46-4d4d-af92-269a1e4cd3f3 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.184366 Apr 20 19:42:51.111090 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 532/1112] 10.222.0.38 () {60 vars in 1137 bytes} [Tue Apr 20 19:42:49 2021] POST /compute/v2.1/servers => generated 405 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 19:42:51.123769 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-33063088-e06c-45f4-936d-e924e37ee93f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:42:51.124514 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-33063088-e06c-45f4-936d-e924e37ee93f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:42:51.206076 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-33063088-e06c-45f4-936d-e924e37ee93f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:42:51.214517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-33063088-e06c-45f4-936d-e924e37ee93f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1095 microversion: 2.1 time: 0.096447 Apr 20 19:42:51.215217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 581/1113] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:42:51 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:42:52.232895 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:42:52.233575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:42:52.241877 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:52.242397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:52.243261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:52.243766 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:52.396530 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:42:52.406507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5485190d-26f5-47f3-bbeb-ce0fcc0bb5a6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1211 microversion: 2.1 time: 0.177969 Apr 20 19:42:52.407134 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 533/1114] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:42:52 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1211 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:42:53.425793 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:42:53.427300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:42:53.437639 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:53.438518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:53.439597 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:53.440573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:53.892354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:42:53.901225 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-bf671ce4-f7fc-41cc-bdca-c39d6fc71c95 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.479679 Apr 20 19:42:53.902638 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 582/1115] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:42:53 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:42:54.446517 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-6f8f8c87-7936-4469-ba18-e3dcc75e93c2 req-ce651ddd-0d4f-4df5-848b-6a3e7a4cb8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168b63e5-df8c-4c1e-8af2-432e7999f773", "tag": "6d469408-77d8-4571-894b-daa30db2e13c"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:42:54.449116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:42:54.449116 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:42:54.459749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6f8f8c87-7936-4469-ba18-e3dcc75e93c2 req-ce651ddd-0d4f-4df5-848b-6a3e7a4cb8f3 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:54.460779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-6f8f8c87-7936-4469-ba18-e3dcc75e93c2 req-ce651ddd-0d4f-4df5-848b-6a3e7a4cb8f3 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:54.485293 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-6f8f8c87-7936-4469-ba18-e3dcc75e93c2 req-ce651ddd-0d4f-4df5-848b-6a3e7a4cb8f3 service nova] Creating event network-changed:6d469408-77d8-4571-894b-daa30db2e13c for instance 168b63e5-df8c-4c1e-8af2-432e7999f773 on hv-cinder-78726 Apr 20 19:42:54.490749 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-6f8f8c87-7936-4469-ba18-e3dcc75e93c2 req-ce651ddd-0d4f-4df5-848b-6a3e7a4cb8f3 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048993 Apr 20 19:42:54.491619 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 534/1116] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:42:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:42:54.920726 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:42:54.921445 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:42:54.929403 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:54.929860 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:54.930702 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:54.931204 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:55.495696 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:42:55.504757 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-867e7f6f-c433-403f-9363-f40e13aeb229 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.589017 Apr 20 19:42:55.505388 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 583/1117] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:42:54 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:42:56.523622 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:42:56.524447 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:42:56.532881 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:56.533389 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:56.534224 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:56.534712 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:56.749386 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:42:56.758245 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-0f7adcf3-561a-49ef-821d-caa2d8b71872 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.239278 Apr 20 19:42:56.758855 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 535/1118] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:42:56 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:42:57.776158 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:42:57.777108 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:42:57.785213 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:57.785719 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:57.786555 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:57.787047 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:57.999603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:42:58.008545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-aeef7f5b-7887-4b78-a32e-e133b9bf8dc6 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.236509 Apr 20 19:42:58.009199 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 584/1119] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:42:57 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:42:59.028910 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:42:59.029583 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:42:59.037480 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:59.037995 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:59.038835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:42:59.039332 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:42:59.254967 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:42:59.264827 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-97b67c14-898f-4912-9672-98fad3ed582d tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.241446 Apr 20 19:42:59.265468 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 536/1120] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:42:59 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:00.283586 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:00.284255 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:00.292171 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:00.292679 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:00.294202 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:00.294692 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:00.507113 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:00.516630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-dc449d80-66fc-4b6f-befd-adc4005b3b41 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.237121 Apr 20 19:43:00.517277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 585/1121] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:00 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:01.535053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:01.535731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:01.544273 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:01.544811 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:01.545655 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:01.546155 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:01.763764 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:01.772509 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-87a8820e-466f-4f79-b63c-9f2ed42916a7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.241714 Apr 20 19:43:01.773163 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 537/1122] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:01 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:02.791676 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:02.792344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:02.800837 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:02.801344 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:02.802176 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:02.802669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:03.024318 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:03.034045 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-d222f011-70e0-41c1-ab9e-1a1b97a98e2a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.246620 Apr 20 19:43:03.034659 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 586/1123] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:02 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:04.053269 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:04.053963 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:04.062436 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:04.062943 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:04.063774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:04.064266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:04.275118 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:04.284397 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-77f5c168-7582-4164-a3b3-483be978dbb4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.235252 Apr 20 19:43:04.285063 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 538/1124] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:04 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:05.302992 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:05.303669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:05.312053 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:05.312568 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:05.313473 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:05.314133 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:05.439630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-fb681980-9284-4158-a5b4-b1ba9e3549e7 req-d6c27f8c-dfdb-460b-8005-1a1b016757c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168b63e5-df8c-4c1e-8af2-432e7999f773", "name": "network-vif-plugged", "status": "completed", "tag": "6d469408-77d8-4571-894b-daa30db2e13c"}]} {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:43:05.442449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:43:05.442449 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:43:05.453004 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fb681980-9284-4158-a5b4-b1ba9e3549e7 req-d6c27f8c-dfdb-460b-8005-1a1b016757c7 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:05.453518 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-fb681980-9284-4158-a5b4-b1ba9e3549e7 req-d6c27f8c-dfdb-460b-8005-1a1b016757c7 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:05.471802 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-fb681980-9284-4158-a5b4-b1ba9e3549e7 req-d6c27f8c-dfdb-460b-8005-1a1b016757c7 service nova] Creating event network-vif-plugged:6d469408-77d8-4571-894b-daa30db2e13c for instance 168b63e5-df8c-4c1e-8af2-432e7999f773 on hv-cinder-78726 Apr 20 19:43:05.477260 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-fb681980-9284-4158-a5b4-b1ba9e3549e7 req-d6c27f8c-dfdb-460b-8005-1a1b016757c7 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 Apr 20 19:43:05.478212 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 539/1125] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:43:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:43:05.549846 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:05.559283 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-16caca11-bc6e-4da2-8b01-5c99e9b778c8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.259819 Apr 20 19:43:05.559904 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 587/1126] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:05 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:06.672381 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:06.673184 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:06.681252 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:06.681763 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:06.682595 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:06.683087 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:06.905717 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:06.914708 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e0662659-c8c7-4608-b740-73cf7a869979 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1266 microversion: 2.1 time: 0.341031 Apr 20 19:43:06.915339 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 540/1127] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:06 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:07.934145 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:07.934821 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:07.942711 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:07.943221 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:07.944055 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:07.944546 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:08.158505 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:08.167487 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-68651708-7665-4fc4-addc-c0fdeada4ae8 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1453 microversion: 2.1 time: 0.238132 Apr 20 19:43:08.168633 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 588/1128] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:07 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:08.186235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:43:08.186849 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:43:08.194689 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:08.195198 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:08.196039 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:08.196534 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:08.550022 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:43:08.559636 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-e1af65b5-e906-40fa-afbb-6032ebc56292 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1453 microversion: 2.1 time: 0.378077 Apr 20 19:43:08.560290 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 541/1129] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:43:08 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1453 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:43:11.943346 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-05eaf37b-57c8-4faf-b4c2-4d97e1597d80 req-4663571b-3865-4c24-a705-9be18113a6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168b63e5-df8c-4c1e-8af2-432e7999f773", "tag": "6d469408-77d8-4571-894b-daa30db2e13c"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:43:11.945523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:43:11.945523 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:43:11.955563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-05eaf37b-57c8-4faf-b4c2-4d97e1597d80 req-4663571b-3865-4c24-a705-9be18113a6f7 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:43:11.956068 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-05eaf37b-57c8-4faf-b4c2-4d97e1597d80 req-4663571b-3865-4c24-a705-9be18113a6f7 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:43:11.973277 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-05eaf37b-57c8-4faf-b4c2-4d97e1597d80 req-4663571b-3865-4c24-a705-9be18113a6f7 service nova] Creating event network-changed:6d469408-77d8-4571-894b-daa30db2e13c for instance 168b63e5-df8c-4c1e-8af2-432e7999f773 on hv-cinder-78726 Apr 20 19:43:11.978828 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-05eaf37b-57c8-4faf-b4c2-4d97e1597d80 req-4663571b-3865-4c24-a705-9be18113a6f7 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039436 Apr 20 19:43:11.979516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 589/1130] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:43:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:44:02.050909 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:44:02.051527 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:44:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:44:11.144052 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:44:11.144669 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:44:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:44:33.587618 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:33.588257 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:33.602105 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:33.602620 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:33.603475 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:33.603970 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:33.658593 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-3dec33f6-7475-404e-a3d7-8d68c96bad7d req-843c4b40-9d27-4b79-80ba-08c8c71b0a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168b63e5-df8c-4c1e-8af2-432e7999f773", "tag": "6d469408-77d8-4571-894b-daa30db2e13c"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:44:33.660274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:44:33.660274 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:44:33.670707 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-3dec33f6-7475-404e-a3d7-8d68c96bad7d req-843c4b40-9d27-4b79-80ba-08c8c71b0a23 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:33.671216 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-3dec33f6-7475-404e-a3d7-8d68c96bad7d req-843c4b40-9d27-4b79-80ba-08c8c71b0a23 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:33.672210 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:44:33.691912 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-3dec33f6-7475-404e-a3d7-8d68c96bad7d req-843c4b40-9d27-4b79-80ba-08c8c71b0a23 service nova] Creating event network-changed:6d469408-77d8-4571-894b-daa30db2e13c for instance 168b63e5-df8c-4c1e-8af2-432e7999f773 on hv-cinder-78726 Apr 20 19:44:33.698378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-3dec33f6-7475-404e-a3d7-8d68c96bad7d req-843c4b40-9d27-4b79-80ba-08c8c71b0a23 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113482 Apr 20 19:44:33.699025 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 590/1131] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:44:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:44:33.805384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-3833985d-b0bb-424c-934b-1d3c0075f305 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "DELETE /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 204 len: 0 microversion: 2.1 time: 0.229030 Apr 20 19:44:33.809516 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 542/1132] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:44:33 2021] DELETE /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:44:33.815525 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:33.816292 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:33.826228 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:33.827119 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:33.828194 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:33.829041 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:34.368657 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:44:34.377767 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b3a01fbb-40d0-4aea-80e2-33c67da7c99f tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1578 microversion: 2.1 time: 0.566692 Apr 20 19:44:34.378405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 591/1133] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:33 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1578 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:44:35.398383 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:35.399165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:35.407291 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:35.407799 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:35.408646 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:35.409169 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:35.877507 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:44:35.886535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6e2c4984-19cd-4afa-815b-57b2e6be460e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1459 microversion: 2.1 time: 0.493168 Apr 20 19:44:35.887261 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 543/1134] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:35 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1459 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:44:36.542405 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-ead364e1-a209-4ed8-a520-58faff249da3 req-9b8ce48d-d116-49a6-a7d6-8e05dee05c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168b63e5-df8c-4c1e-8af2-432e7999f773", "name": "network-vif-deleted", "tag": "6d469408-77d8-4571-894b-daa30db2e13c"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:44:36.544165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:44:36.544165 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:44:36.555001 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ead364e1-a209-4ed8-a520-58faff249da3 req-9b8ce48d-d116-49a6-a7d6-8e05dee05c97 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:36.555499 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-ead364e1-a209-4ed8-a520-58faff249da3 req-9b8ce48d-d116-49a6-a7d6-8e05dee05c97 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:36.575654 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-ead364e1-a209-4ed8-a520-58faff249da3 req-9b8ce48d-d116-49a6-a7d6-8e05dee05c97 service nova] Creating event network-vif-deleted:6d469408-77d8-4571-894b-daa30db2e13c for instance 168b63e5-df8c-4c1e-8af2-432e7999f773 on hv-cinder-78726 Apr 20 19:44:36.581715 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-ead364e1-a209-4ed8-a520-58faff249da3 req-9b8ce48d-d116-49a6-a7d6-8e05dee05c97 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042796 Apr 20 19:44:36.582501 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 592/1135] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:44:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:44:36.906067 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:36.906779 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:36.915329 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:36.915933 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:36.916835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:36.917335 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:37.087563 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:44:37.096879 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6d620be2-cb48-44ef-a316-3dc2e604070b tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 200 len: 1226 microversion: 2.1 time: 0.194742 Apr 20 19:44:37.097460 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 544/1136] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:36 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 1226 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:44:38.117483 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:38.118266 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 168b63e5-df8c-4c1e-8af2-432e7999f773] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:38.126579 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:38.127089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:38.127926 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:38.128421 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:38.181781 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] HTTP exception thrown: Instance 168b63e5-df8c-4c1e-8af2-432e7999f773 could not be found. Apr 20 19:44:38.182440 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Returning 404 to user: Instance 168b63e5-df8c-4c1e-8af2-432e7999f773 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:44:38.183331 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-2fb90897-8121-41d4-aab2-ed0b8a4fecec tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773" status: 404 len: 111 microversion: 2.1 time: 0.071449 Apr 20 19:44:38.183923 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 593/1137] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:38 2021] GET /compute/v2.1/servers/168b63e5-df8c-4c1e-8af2-432e7999f773 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:44:42.356356 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:42.357102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:42.358759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-916d8be1-bb13-4c2b-b8cc-33455a2a35af req-fc6361d8-955c-41a4-89de-575e90ec6dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cea3375-150c-4b7e-a676-f1ea51ea5907", "tag": "36368e85-b55d-4ef4-b77c-7cb79d3e9efd"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:44:42.360774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:44:42.360774 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:44:42.365914 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:42.366430 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:42.367337 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:42.367844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:42.370102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-916d8be1-bb13-4c2b-b8cc-33455a2a35af req-fc6361d8-955c-41a4-89de-575e90ec6dfa service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:42.370603 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-916d8be1-bb13-4c2b-b8cc-33455a2a35af req-fc6361d8-955c-41a4-89de-575e90ec6dfa service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:42.388340 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-916d8be1-bb13-4c2b-b8cc-33455a2a35af req-fc6361d8-955c-41a4-89de-575e90ec6dfa service nova] Creating event network-changed:36368e85-b55d-4ef4-b77c-7cb79d3e9efd for instance 4cea3375-150c-4b7e-a676-f1ea51ea5907 on hv-cinder-78726 Apr 20 19:44:42.394500 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-916d8be1-bb13-4c2b-b8cc-33455a2a35af req-fc6361d8-955c-41a4-89de-575e90ec6dfa service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039017 Apr 20 19:44:42.395731 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 594/1138] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:44:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:44:42.438979 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Going to try to terminate instance {{(pid=100563) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 19:44:42.563375 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-6254b020-be7e-4c73-80cc-c719b0919bbf tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 204 len: 0 microversion: 2.1 time: 0.210065 Apr 20 19:44:42.564384 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 545/1139] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:44:42 2021] DELETE /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 19:44:42.574442 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:42.575728 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:42.584137 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:42.584944 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:42.585803 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:42.586300 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:43.034545 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100562) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:44:43.044301 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-9aa2583a-d17f-4d02-9d5e-296fcb6a0047 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1576 microversion: 2.1 time: 0.474474 Apr 20 19:44:43.045214 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 595/1140] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:42 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1576 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:44:44.063887 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:44.064668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:44.073725 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:44.074242 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:44.075114 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:44.075575 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:44.341410 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:44:44.351128 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-b93c4284-2994-47e6-85e8-fda985b34ee4 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1457 microversion: 2.1 time: 0.291983 Apr 20 19:44:44.351759 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 546/1141] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:44 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1457 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:44:45.148183 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [req-938878de-a94b-4b8e-a603-0bce90e1d809 req-e56052bb-4aff-42be-a5ca-a40a3b0a8034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cea3375-150c-4b7e-a676-f1ea51ea5907", "name": "network-vif-deleted", "tag": "36368e85-b55d-4ef4-b77c-7cb79d3e9efd"}]} {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 19:44:45.150018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 19:44:45.150018 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: warnings.warn(msg) Apr 20 19:44:45.159338 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-938878de-a94b-4b8e-a603-0bce90e1d809 req-e56052bb-4aff-42be-a5ca-a40a3b0a8034 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:45.159835 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [req-938878de-a94b-4b8e-a603-0bce90e1d809 req-e56052bb-4aff-42be-a5ca-a40a3b0a8034 service nova] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:45.178656 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.compute.server_external_events [req-938878de-a94b-4b8e-a603-0bce90e1d809 req-e56052bb-4aff-42be-a5ca-a40a3b0a8034 service nova] Creating event network-vif-deleted:36368e85-b55d-4ef4-b77c-7cb79d3e9efd for instance 4cea3375-150c-4b7e-a676-f1ea51ea5907 on hv-cinder-78726 Apr 20 19:44:45.183845 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [req-938878de-a94b-4b8e-a603-0bce90e1d809 req-e56052bb-4aff-42be-a5ca-a40a3b0a8034 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039874 Apr 20 19:44:45.184511 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 596/1142] 10.222.0.38 () {64 vars in 1308 bytes} [Tue Apr 20 19:44:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 19:44:45.370305 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:45.370902 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:45.378776 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:45.379279 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:45.380751 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:45.381235 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:45.527856 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.policy [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6b3e2cfd68144908bb22abb969cbd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3608ab590f13437caf52ce138af80c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100563) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 19:44:45.541102 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-fc9a3508-c0e1-4599-b927-8225d1dfcdd7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 200 len: 1225 microversion: 2.1 time: 0.175088 Apr 20 19:44:45.541911 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 547/1143] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:45 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 19:44:46.559408 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:46.560200 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 4cea3375-150c-4b7e-a676-f1ea51ea5907] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:46.568924 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:46.569432 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:46.570276 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:46.570773 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:46.624234 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] HTTP exception thrown: Instance 4cea3375-150c-4b7e-a676-f1ea51ea5907 could not be found. Apr 20 19:44:46.624958 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Returning 404 to user: Instance 4cea3375-150c-4b7e-a676-f1ea51ea5907 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:44:46.625854 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-02ca6229-1daf-4ae3-a7b3-1ded10497db7 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907" status: 404 len: 111 microversion: 2.1 time: 0.071010 Apr 20 19:44:46.626471 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 597/1144] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:46 2021] GET /compute/v2.1/servers/4cea3375-150c-4b7e-a676-f1ea51ea5907 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:44:47.444535 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:47.445147 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100563) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:47.452913 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:47.453413 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:47.454249 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:47.454742 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100563) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:47.507422 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] HTTP exception thrown: Instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 could not be found. Apr 20 19:44:47.508083 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Returning 404 to user: Instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 could not be found. {{(pid=100563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:44:47.509006 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-5ea11490-30d0-4c42-a770-5d689bc7c3a2 tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "DELETE /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 404 len: 111 microversion: 2.1 time: 0.069402 Apr 20 19:44:47.509601 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 548/1145] 10.222.0.38 () {58 vars in 1229 bytes} [Tue Apr 20 19:44:47 2021] DELETE /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:44:47.518378 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '>' {{(pid=100562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:47.519056 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.compute.api [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] [instance: 6321bd2f-86d9-4a91-9767-a3f6ecc51353] Fetching instance by UUID {{(pid=100562) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 19:44:47.527844 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:47.528354 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:47.529222 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 19:44:47.529720 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG oslo_concurrency.lockutils [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Lock "3be5d8b8-8cd8-4f91-931a-f0226a33b3ec" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100562) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 19:44:47.582304 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.wsgi [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] HTTP exception thrown: Instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 could not be found. Apr 20 19:44:47.583573 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Returning 404 to user: Instance 6321bd2f-86d9-4a91-9767-a3f6ecc51353 could not be found. {{(pid=100562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 19:44:47.584485 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-4183a562-7613-48e7-8243-377523bfbf1a tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353" status: 404 len: 111 microversion: 2.1 time: 0.070253 Apr 20 19:44:47.585123 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100562|app: 0|req: 598/1146] 10.222.0.38 () {58 vars in 1226 bytes} [Tue Apr 20 19:44:47 2021] GET /compute/v2.1/servers/6321bd2f-86d9-4a91-9767-a3f6ecc51353 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 19:44:49.043217 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: DEBUG nova.api.openstack.wsgi [None req-cabc0d29-67c4-42d6-b57b-6f9ba60d590e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] Calling method '.version_select at 0x7f0394143730>' {{(pid=100563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 19:44:49.064131 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO nova.api.openstack.requestlog [None req-cabc0d29-67c4-42d6-b57b-6f9ba60d590e tempest-TestVolumeBootPattern-862995944 tempest-TestVolumeBootPattern-862995944-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1038747756" status: 202 len: 0 microversion: 2.1 time: 0.024900 Apr 20 19:44:49.064777 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: [pid: 100563|app: 0|req: 549/1147] 10.222.0.38 () {58 vars in 1253 bytes} [Tue Apr 20 19:44:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1038747756 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 19:45:20.424046 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:45:20.424668 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:45:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:45:42.157412 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:45:42.158019 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:45:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:47:22.070026 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:47:22.070630 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:47:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:47:31.162850 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:47:31.163536 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:47:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:47:47.859391 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:47:47.859964 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:47:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:47:50.054060 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:47:50.054616 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:47:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:48:40.441722 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:48:40.442315 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:48:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 19:49:02.174404 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 19:49:02.175089 dv-cinder-787264-1-iscsi devstack@n-api.service[100561]: Tue Apr 20 19:49:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!